[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:15 dist-test-slave-srgv krb5kdc[21470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:15 dist-test-slave-srgv krb5kdc[21470](info): set up 2 sockets
Aug 06 13:01:15 dist-test-slave-srgv krb5kdc[21470](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 13:01:16.196489 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.008s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:16 dist-test-slave-srgv krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:16.338863 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36497
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:36497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:16.443975 21483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:16.444305 21483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:16.444337 21483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:16.445963 21483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:16.446029 21483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:16.446045 21483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:16.446059 21483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:16.446072 21483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:16.448316 21483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:36497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:16.448863 21483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:16.449219 21483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:16.458243 21491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:16.458408 21489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:16.458461 21488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:16.459431 21483 server_base.cc:1034] running on GCE node
I20260806 13:01:16.459830 21483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:16.460307 21483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:16.461500 21483 hybrid_clock.cc:648] HybridClock initialized: now 1786021276461482 us; error 93 us; skew 500 ppm
Aug 06 13:01:16 dist-test-slave-srgv krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021276, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:16.464972 21483 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:16.465900 21483 webserver.cc:460] Webserver started at http://127.20.245.190:36755/ using document root <none> and password file <none>
I20260806 13:01:16.466332 21483 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:16.466423 21483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:16.466675 21483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:16.468381 21483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "fe1d9d63657d461b96ca501cf62fc16a"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "2164a891128494c800fdba98bc396649"
server_key_iv: "47f87e86afd05e489fafa3cda8da4eee"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.468861 21483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "fe1d9d63657d461b96ca501cf62fc16a"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "2164a891128494c800fdba98bc396649"
server_key_iv: "47f87e86afd05e489fafa3cda8da4eee"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.471128 21483 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:16.472586 21498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:16.472992 21483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:16.473124 21483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "fe1d9d63657d461b96ca501cf62fc16a"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "2164a891128494c800fdba98bc396649"
server_key_iv: "47f87e86afd05e489fafa3cda8da4eee"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.473242 21483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:16.521190 21483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:16.524958 21483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:16.525238 21483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:16.531642 21483 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:36497
I20260806 13:01:16.531731 21551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:36497 every 8 connection(s)
I20260806 13:01:16.532420 21483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:16.534121 21552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:16.536718 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 21483
I20260806 13:01:16.536851 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:16.537561 21462 external_mini_cluster.cc:1428] Setting key 0b4e82bb38aebee22ad790b296134c63
I20260806 13:01:16.538094 21552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a: Bootstrap starting.
I20260806 13:01:16.539551 21552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:16.540098 21552 log.cc:824] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:16.541043 21552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a: No bootstrap required, opened a new log
I20260806 13:01:16.543120 21552 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe1d9d63657d461b96ca501cf62fc16a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36497 } }
I20260806 13:01:16.543396 21552 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:16.543546 21552 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe1d9d63657d461b96ca501cf62fc16a, State: Initialized, Role: FOLLOWER
I20260806 13:01:16.543762 21552 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe1d9d63657d461b96ca501cf62fc16a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36497 } }
I20260806 13:01:16.543912 21552 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:16.543962 21552 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:16.544014 21552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:16.545166 21552 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe1d9d63657d461b96ca501cf62fc16a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36497 } }
I20260806 13:01:16.545372 21552 leader_election.cc:302] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe1d9d63657d461b96ca501cf62fc16a; no voters:
I20260806 13:01:16.545666 21552 leader_election.cc:288] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:16.545704 21557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:16.545894 21557 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [term 1 LEADER]: Becoming Leader. State: Replica: fe1d9d63657d461b96ca501cf62fc16a, State: Running, Role: LEADER
I20260806 13:01:16.546097 21557 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe1d9d63657d461b96ca501cf62fc16a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36497 } }
I20260806 13:01:16.546344 21552 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:16.546877 21559 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe1d9d63657d461b96ca501cf62fc16a. Latest consensus state: current_term: 1 leader_uuid: "fe1d9d63657d461b96ca501cf62fc16a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe1d9d63657d461b96ca501cf62fc16a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36497 } } }
I20260806 13:01:16.546958 21559 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:16.547436 21558 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe1d9d63657d461b96ca501cf62fc16a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe1d9d63657d461b96ca501cf62fc16a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36497 } } }
I20260806 13:01:16.547616 21558 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:16.547991 21562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:16.549567 21562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 13:01:16 dist-test-slave-srgv krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:16.554109 21562 catalog_manager.cc:1347] Generated new cluster ID: 95335eec841644f3a3eb0c11af4036aa
I20260806 13:01:16.554173 21562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:16.560222 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:16.539304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35296 (local address 127.20.245.190:36497)
0806 13:01:16.539685 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:16.539698 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:16.540015 (+ 317us) server_negotiation.cc:407] Connection header received
0806 13:01:16.543087 (+ 3072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:16.543096 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:16.543309 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:16.543477 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:16.545415 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:16.546736 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:16.548602 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:16.549132 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:16.549276 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:16.555019 (+ 5743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:16.555026 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:16.555026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:16.555043 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:16.557544 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:16.558119 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:16.558124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:16.558125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:16.558270 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:16.558581 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:16.558582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:16.558583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:16.559019 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:16.559248 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:16.559544 (+ 296us) server_negotiation.cc:299] Negotiation successful
0806 13:01:16.559825 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":114,"threads_started":1}
I20260806 13:01:16.564720 21562 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:16.566208 21562 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:16.583909 21562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe1d9d63657d461b96ca501cf62fc16a: Generated new TSK 0
I20260806 13:01:16.584313 21562 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:16.623975 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36497
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:16.738438 21578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:16.738736 21578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:16.738770 21578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:16.740443 21578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:16.740509 21578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:16.740543 21578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:16.742365 21578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36497
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:16.742791 21578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:16.743103 21578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:16.749965 21585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:16.749922 21587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:16.749936 21584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:16.749971 21578 server_base.cc:1034] running on GCE node
I20260806 13:01:16.750447 21578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:16.750742 21578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:16.751906 21578 hybrid_clock.cc:648] HybridClock initialized: now 1786021276751876 us; error 45 us; skew 500 ppm
Aug 06 13:01:16 dist-test-slave-srgv krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021276, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:16.755260 21578 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:16.755766 21578 webserver.cc:460] Webserver started at http://127.20.245.129:39435/ using document root <none> and password file <none>
I20260806 13:01:16.756024 21578 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:16.756079 21578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:16.756201 21578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:16.757565 21578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "aaede3b600b14f5fbf50da46125a9cf4"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "5e17a7baac78cff1d0c4029e70e4b44d"
server_key_iv: "ecbfa87fcb739acc6d23334b01baacc5"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.757958 21578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "aaede3b600b14f5fbf50da46125a9cf4"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "5e17a7baac78cff1d0c4029e70e4b44d"
server_key_iv: "ecbfa87fcb739acc6d23334b01baacc5"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.759619 21578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 13:01:16.760614 21594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:16.760814 21578 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:16.760941 21578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "aaede3b600b14f5fbf50da46125a9cf4"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "5e17a7baac78cff1d0c4029e70e4b44d"
server_key_iv: "ecbfa87fcb739acc6d23334b01baacc5"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.761041 21578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:16.782258 21578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:16.785626 21578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:16.785869 21578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:16.786289 21578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:16.786790 21578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:16.786895 21578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:16.786947 21578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:16.786988 21578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:16.796475 21578 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:35793
I20260806 13:01:16.796525 21709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:35793 every 8 connection(s)
I20260806 13:01:16.796970 21578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:16.801993 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 21578
I20260806 13:01:16.802102 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:16.802299 21462 external_mini_cluster.cc:1428] Setting key 743d8d908652e5dbfaee28b45ace9e67
Aug 06 13:01:16 dist-test-slave-srgv krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021276, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:16.810515 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:16.798208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:40507 (local address 127.20.245.190:36497)
0806 13:01:16.798310 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:16.798313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:16.798485 (+ 172us) server_negotiation.cc:407] Connection header received
0806 13:01:16.799155 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:16.799156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:16.799220 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:16.799284 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:16.800823 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:16.801429 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:16.803137 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:16.803521 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:16.803625 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:16.806699 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:16.806701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:16.806702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:16.806711 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:16.808495 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:16.809128 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:16.809129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:16.809129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:16.809196 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:16.809583 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:16.809584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:16.809584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:16.809742 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:16.809807 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:16.810295 (+ 488us) server_negotiation.cc:299] Negotiation successful
0806 13:01:16.810418 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 13:01:16.810911 21712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:16.798118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36497 (local address 127.20.245.129:40507)
0806 13:01:16.798326 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:16.798376 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:16.799043 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:16.799359 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:16.799364 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:16.800391 (+ 1027us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:16.800698 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:16.800706 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:16.801532 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:16.801534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:16.802967 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:16.802971 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:16.803653 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:16.803655 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:16.803820 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:16.804528 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:16.804538 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:16.806581 (+ 2043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:16.808615 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:16.808629 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:16.808634 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:16.809041 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:16.809281 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:16.809282 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:16.809282 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:16.809477 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:16.809832 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:16.809841 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:16.810085 (+ 244us) client_negotiation.cc:769] Sending connection context
0806 13:01:16.810237 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 13:01:16.810489 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":122,"threads_started":1}
I20260806 13:01:16.811770 21710 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36497
I20260806 13:01:16.811987 21710 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:16.812361 21710 heartbeater.cc:511] Master 127.20.245.190:36497 requested a full tablet report, sending...
I20260806 13:01:16.813627 21515 ts_manager.cc:194] Registered new tserver with Master: aaede3b600b14f5fbf50da46125a9cf4 (127.20.245.129:35793)
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:01:16.814690 21515 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:40507
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:16.835314 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36497
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:16.959956 21715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:16.960260 21715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:16.960292 21715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:16.961692 21715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:16.961750 21715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:16.961784 21715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:16.964010 21715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36497
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:16.964386 21715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:16.964663 21715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:16.971777 21722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:16.971836 21721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:16.971925 21715 server_base.cc:1034] running on GCE node
W20260806 13:01:16.971797 21724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:16.972173 21715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:16.972532 21715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:16.973722 21715 hybrid_clock.cc:648] HybridClock initialized: now 1786021276973721 us; error 53 us; skew 500 ppm
Aug 06 13:01:16 dist-test-slave-srgv krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021276, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:16.977099 21715 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:16.977869 21715 webserver.cc:460] Webserver started at http://127.20.245.130:46547/ using document root <none> and password file <none>
I20260806 13:01:16.978192 21715 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:16.978247 21715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:16.978434 21715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:16.980048 21715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "dbf915f919494563be8b0b5721a29ffb"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "4934a7c57d08f44fa22737b036ac0276"
server_key_iv: "23df76071e9a081b572533703a6cbcdb"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.980552 21715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "dbf915f919494563be8b0b5721a29ffb"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "4934a7c57d08f44fa22737b036ac0276"
server_key_iv: "23df76071e9a081b572533703a6cbcdb"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.982620 21715 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:16.983870 21731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:16.984172 21715 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:16.984275 21715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "dbf915f919494563be8b0b5721a29ffb"
format_stamp: "Formatted at 2026-08-06 13:01:16 on dist-test-slave-srgv"
server_key: "4934a7c57d08f44fa22737b036ac0276"
server_key_iv: "23df76071e9a081b572533703a6cbcdb"
server_key_version: "encryptionkey@0"
I20260806 13:01:16.984393 21715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:17.003274 21715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:17.006732 21715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:17.006971 21715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:17.007459 21715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:17.007987 21715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:17.008028 21715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:17.008055 21715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:17.008091 21715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:17.020098 21715 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:35469
I20260806 13:01:17.020296 21848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:35469 every 8 connection(s)
I20260806 13:01:17.020848 21715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:17.023784 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 21715
I20260806 13:01:17.023917 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:17.024196 21462 external_mini_cluster.cc:1428] Setting key 631e8def5722de65880d1d9a1c86285c
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021276, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:17.033706 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:17.021972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:36361 (local address 127.20.245.190:36497)
0806 13:01:17.022057 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:17.022059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:17.022372 (+ 313us) server_negotiation.cc:407] Connection header received
0806 13:01:17.023259 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:17.023262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:17.023280 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:17.023344 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:17.024697 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.025264 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.026452 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.026669 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.026776 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:17.029836 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:17.029838 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:17.029838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:17.029847 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:17.031703 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:17.032337 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:17.032338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:17.032339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:17.032407 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:17.032746 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:17.032747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:17.032747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:17.032882 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:17.032938 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:17.033348 (+ 410us) server_negotiation.cc:299] Negotiation successful
0806 13:01:17.033463 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 13:01:17.034070 21851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:17.021927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36497 (local address 127.20.245.130:36361)
0806 13:01:17.022201 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:17.022251 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:17.023095 (+ 844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:17.023442 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:17.023447 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:17.024238 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:17.024587 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:17.024595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.025370 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.025371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:17.026353 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:17.026356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.026766 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.026767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:17.026974 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:17.027750 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:17.027782 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:17.029687 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:17.031794 (+ 2107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:17.031804 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:17.031808 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:17.032227 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:17.032483 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:17.032484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:17.032485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:17.032673 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:17.032951 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:17.032960 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:17.033170 (+ 210us) client_negotiation.cc:769] Sending connection context
0806 13:01:17.033321 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 13:01:17.033565 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":142,"threads_started":1}
I20260806 13:01:17.034840 21849 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36497
I20260806 13:01:17.034983 21849 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:17.035317 21849 heartbeater.cc:511] Master 127.20.245.190:36497 requested a full tablet report, sending...
I20260806 13:01:17.035828 21515 ts_manager.cc:194] Registered new tserver with Master: dbf915f919494563be8b0b5721a29ffb (127.20.245.130:35469)
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
I20260806 13:01:17.036304 21515 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:36361
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:17.057950 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36497
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:17.176481 21854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:17.176810 21854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:17.176859 21854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:17.178493 21854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:17.178581 21854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:17.178634 21854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:17.180512 21854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36497
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:17.180872 21854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:17.181188 21854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:17.187582 21862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:17.187750 21854 server_base.cc:1034] running on GCE node
W20260806 13:01:17.187644 21860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:17.187728 21859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:17.188191 21854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:17.188510 21854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:17.189685 21854 hybrid_clock.cc:648] HybridClock initialized: now 1786021277189657 us; error 47 us; skew 500 ppm
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021277, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:17.193015 21854 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:17.193653 21854 webserver.cc:460] Webserver started at http://127.20.245.131:43143/ using document root <none> and password file <none>
I20260806 13:01:17.193949 21854 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:17.194031 21854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:17.194202 21854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:17.195638 21854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "5cd1bd2504074207826e2cb7872ceb08"
format_stamp: "Formatted at 2026-08-06 13:01:17 on dist-test-slave-srgv"
server_key: "d09a587bb08c03365eedced9e6b7b178"
server_key_iv: "f17f89acf45e9d7913e456843f4acb47"
server_key_version: "encryptionkey@0"
I20260806 13:01:17.196087 21854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "5cd1bd2504074207826e2cb7872ceb08"
format_stamp: "Formatted at 2026-08-06 13:01:17 on dist-test-slave-srgv"
server_key: "d09a587bb08c03365eedced9e6b7b178"
server_key_iv: "f17f89acf45e9d7913e456843f4acb47"
server_key_version: "encryptionkey@0"
I20260806 13:01:17.198616 21854 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:17.199787 21869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:17.199999 21854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:17.200121 21854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "5cd1bd2504074207826e2cb7872ceb08"
format_stamp: "Formatted at 2026-08-06 13:01:17 on dist-test-slave-srgv"
server_key: "d09a587bb08c03365eedced9e6b7b178"
server_key_iv: "f17f89acf45e9d7913e456843f4acb47"
server_key_version: "encryptionkey@0"
I20260806 13:01:17.200217 21854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:17.218595 21854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:17.221694 21854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:17.221927 21854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:17.222357 21854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:17.222822 21854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:17.222885 21854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:17.222926 21854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:17.222970 21854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:17.235157 21854 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:36149
I20260806 13:01:17.235323 21985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:36149 every 8 connection(s)
I20260806 13:01:17.235845 21854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021277, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:17.245826 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 21854
I20260806 13:01:17.246003 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:17.246269 21462 external_mini_cluster.cc:1428] Setting key fab072519aa6291c74c7e4f3cc9d9b52
I20260806 13:01:17.249615 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:17.237131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:40199 (local address 127.20.245.190:36497)
0806 13:01:17.237234 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:17.237237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:17.237561 (+ 324us) server_negotiation.cc:407] Connection header received
0806 13:01:17.238441 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:17.238442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:17.238461 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:17.238537 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:17.239989 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.240567 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.241834 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.242052 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.242165 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:17.245241 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:17.245244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:17.245244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:17.245257 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:17.247638 (+ 2381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:17.248369 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:17.248371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:17.248371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:17.248455 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:17.248719 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:17.248721 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:17.248721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:17.248882 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:17.248961 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:17.249420 (+ 459us) server_negotiation.cc:299] Negotiation successful
0806 13:01:17.249523 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 13:01:17.249853 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:17.237055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36497 (local address 127.20.245.131:40199)
0806 13:01:17.237355 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:17.237406 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:17.238299 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:17.238636 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:17.238640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:17.239545 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:17.239879 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:17.239886 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.240698 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.240699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:17.241740 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:17.241743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.242184 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.242185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:17.242345 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:17.243141 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:17.243152 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:17.245091 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:17.247760 (+ 2669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:17.247773 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:17.247776 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:17.248294 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:17.248524 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:17.248524 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:17.248525 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:17.248641 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:17.248978 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:17.248986 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:17.249156 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 13:01:17.249339 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 13:01:17.249527 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":163,"threads_started":1}
I20260806 13:01:17.250735 21986 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36497
I20260806 13:01:17.250881 21986 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:17.251216 21986 heartbeater.cc:511] Master 127.20.245.190:36497 requested a full tablet report, sending...
I20260806 13:01:17.251822 21515 ts_manager.cc:194] Registered new tserver with Master: 5cd1bd2504074207826e2cb7872ceb08 (127.20.245.131:36149)
I20260806 13:01:17.252298 21515 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:40199
I20260806 13:01:17.259970 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021277, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021277, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:17.292392 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:17.281869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34858 (local address 127.20.245.129:35793)
0806 13:01:17.282036 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:17.282044 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:17.282062 (+ 18us) server_negotiation.cc:407] Connection header received
0806 13:01:17.282112 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:17.282115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:17.282175 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:17.282251 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:17.282883 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.283799 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.284623 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.285007 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.285069 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:17.288029 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:17.288087 (+ 58us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:17.288088 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:17.288110 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:17.290538 (+ 2428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:17.291015 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:17.291020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:17.291025 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:17.291349 (+ 324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:17.291593 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:17.291595 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:17.291595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:17.291812 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:17.292012 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:17.292062 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 13:01:17.292172 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
W20260806 13:01:17.293006 21622 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34858
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:17.322765 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:17.313948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34860 (local address 127.20.245.129:35793)
0806 13:01:17.314033 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:17.314035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:17.314113 (+ 78us) server_negotiation.cc:407] Connection header received
0806 13:01:17.314224 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:17.314225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:17.314245 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:17.314301 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:17.314964 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.315587 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.316400 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:17.316625 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:17.316724 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:17.319716 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:17.319718 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:17.319719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:17.319729 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:17.321355 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:17.321844 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:17.321846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:17.321846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:17.321915 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:17.322121 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:17.322122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:17.322122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:17.322248 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:17.322364 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:17.322510 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 13:01:17.322622 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 13:01:17.323688 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 21578
I20260806 13:01:17.330071 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 21715
I20260806 13:01:17.337296 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 21854
I20260806 13:01:17.343669 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 21483
2026-08-06T13:01:17Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2261 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[22000](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[22000](info): set up 2 sockets
Aug 06 13:01:17 dist-test-slave-srgv krb5kdc[22000](info): commencing operation
krb5kdc: starting...
W20260806 13:01:18.459367 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:18 dist-test-slave-srgv krb5kdc[22000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:18.606325 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:42791
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:37923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:42791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:18.710466 22014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:18.710805 22014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:18.710836 22014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:18.712445 22014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:18.712517 22014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:18.712534 22014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:18.712548 22014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:18.712561 22014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:18.714486 22014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:37923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:42791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:42791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:18.714849 22014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:18.715225 22014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:18.721486 22022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:18.721699 22014 server_base.cc:1034] running on GCE node
W20260806 13:01:18.721489 22019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:18.721486 22020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:18.722152 22014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:18.722587 22014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:18.723755 22014 hybrid_clock.cc:648] HybridClock initialized: now 1786021278723733 us; error 45 us; skew 500 ppm
Aug 06 13:01:18 dist-test-slave-srgv krb5kdc[22000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021278, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:18.726958 22014 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:18.727552 22014 webserver.cc:460] Webserver started at http://127.20.245.190:43677/ using document root <none> and password file <none>
I20260806 13:01:18.727824 22014 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:18.727895 22014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:18.728060 22014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:18.729382 22014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "c2e39e16aef54995b3c2101ded721ab4"
format_stamp: "Formatted at 2026-08-06 13:01:18 on dist-test-slave-srgv"
server_key: "cf39118c6da4348bbff3f133c3a90f5f"
server_key_iv: "1ba504025d7b8457362bd253cc9e42a0"
server_key_version: "encryptionkey@0"
I20260806 13:01:18.729820 22014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "c2e39e16aef54995b3c2101ded721ab4"
format_stamp: "Formatted at 2026-08-06 13:01:18 on dist-test-slave-srgv"
server_key: "cf39118c6da4348bbff3f133c3a90f5f"
server_key_iv: "1ba504025d7b8457362bd253cc9e42a0"
server_key_version: "encryptionkey@0"
I20260806 13:01:18.731513 22014 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260806 13:01:18.732484 22029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:18.732712 22014 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:18.732828 22014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "c2e39e16aef54995b3c2101ded721ab4"
format_stamp: "Formatted at 2026-08-06 13:01:18 on dist-test-slave-srgv"
server_key: "cf39118c6da4348bbff3f133c3a90f5f"
server_key_iv: "1ba504025d7b8457362bd253cc9e42a0"
server_key_version: "encryptionkey@0"
I20260806 13:01:18.732926 22014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:18.746937 22014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:18.750054 22014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:18.750263 22014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:18.755879 22014 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:42791
I20260806 13:01:18.755978 22083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:42791 every 8 connection(s)
I20260806 13:01:18.756433 22014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:18.757674 22084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:18.761255 22084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4: Bootstrap starting.
I20260806 13:01:18.762163 22084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:18.762631 22084 log.cc:824] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:18.763722 22084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4: No bootstrap required, opened a new log
I20260806 13:01:18.764487 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 22014
I20260806 13:01:18.764642 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:18.764844 21462 external_mini_cluster.cc:1428] Setting key e5133ba6478e1ea195d9db19e9832575
I20260806 13:01:18.766496 22084 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e39e16aef54995b3c2101ded721ab4" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42791 } }
I20260806 13:01:18.766742 22084 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:18.766798 22084 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e39e16aef54995b3c2101ded721ab4, State: Initialized, Role: FOLLOWER
I20260806 13:01:18.766971 22084 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e39e16aef54995b3c2101ded721ab4" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42791 } }
I20260806 13:01:18.767079 22084 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:18.767120 22084 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:18.767210 22084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:18.768842 22084 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e39e16aef54995b3c2101ded721ab4" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42791 } }
I20260806 13:01:18.768999 22084 leader_election.cc:302] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2e39e16aef54995b3c2101ded721ab4; no voters:
I20260806 13:01:18.769227 22084 leader_election.cc:288] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:18.769271 22089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:18.769456 22089 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [term 1 LEADER]: Becoming Leader. State: Replica: c2e39e16aef54995b3c2101ded721ab4, State: Running, Role: LEADER
I20260806 13:01:18.769568 22084 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:18.769598 22089 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e39e16aef54995b3c2101ded721ab4" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42791 } }
I20260806 13:01:18.770026 22090 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2e39e16aef54995b3c2101ded721ab4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e39e16aef54995b3c2101ded721ab4" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42791 } } }
I20260806 13:01:18.770136 22090 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:18.770360 22091 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2e39e16aef54995b3c2101ded721ab4. Latest consensus state: current_term: 1 leader_uuid: "c2e39e16aef54995b3c2101ded721ab4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e39e16aef54995b3c2101ded721ab4" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42791 } } }
I20260806 13:01:18.770431 22091 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:18.770423 22095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:18.771222 22095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:18.773742 22095 catalog_manager.cc:1347] Generated new cluster ID: 2394886989e24bc48a7d0f8e14a14b1e
I20260806 13:01:18.773800 22095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:01:18 dist-test-slave-srgv krb5kdc[22000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:18.780049 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:18.765684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49108 (local address 127.20.245.190:42791)
0806 13:01:18.765967 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:18.765981 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:18.766030 (+ 49us) server_negotiation.cc:407] Connection header received
0806 13:01:18.766426 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:18.766437 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:18.766524 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:18.766944 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:18.767725 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:18.769561 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:18.771062 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:18.771982 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:18.772135 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:18.775364 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:18.775375 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:18.775375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:18.775390 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:18.777526 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:18.777977 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:18.777981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:18.777982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:18.778608 (+ 626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:18.778870 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:18.778871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:18.778872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:18.779253 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:18.779470 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:18.779568 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 13:01:18.779758 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":124,"threads_started":1}
I20260806 13:01:18.799394 22095 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:18.800331 22095 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:18.803541 22095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2e39e16aef54995b3c2101ded721ab4: Generated new TSK 0
I20260806 13:01:18.803854 22095 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:18.840583 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42791
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:37923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:18.941910 22110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:18.942262 22110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:18.942315 22110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:18.943734 22110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:18.943827 22110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:18.943881 22110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:18.945719 22110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:37923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:18.946135 22110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:18.946467 22110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:18.952997 22116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:18.952997 22118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:18.952997 22115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:18.953413 22110 server_base.cc:1034] running on GCE node
I20260806 13:01:18.953730 22110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:18.954041 22110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:18.955238 22110 hybrid_clock.cc:648] HybridClock initialized: now 1786021278955215 us; error 38 us; skew 500 ppm
Aug 06 13:01:18 dist-test-slave-srgv krb5kdc[22000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021278, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:18.958721 22110 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:18.959440 22110 webserver.cc:460] Webserver started at http://127.20.245.129:42167/ using document root <none> and password file <none>
I20260806 13:01:18.959751 22110 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:18.959824 22110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:18.959995 22110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:18.961341 22110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "3fb399c47cb84cce9c94202e6325b8af"
format_stamp: "Formatted at 2026-08-06 13:01:18 on dist-test-slave-srgv"
server_key: "d1e7736359c90670dc04c4a0d4b458ba"
server_key_iv: "5280f12f4a6709d6645096dd23747b6e"
server_key_version: "encryptionkey@0"
I20260806 13:01:18.961814 22110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "3fb399c47cb84cce9c94202e6325b8af"
format_stamp: "Formatted at 2026-08-06 13:01:18 on dist-test-slave-srgv"
server_key: "d1e7736359c90670dc04c4a0d4b458ba"
server_key_iv: "5280f12f4a6709d6645096dd23747b6e"
server_key_version: "encryptionkey@0"
I20260806 13:01:18.964208 22110 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 13:01:18.965404 22125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:18.965724 22110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:18.965889 22110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "3fb399c47cb84cce9c94202e6325b8af"
format_stamp: "Formatted at 2026-08-06 13:01:18 on dist-test-slave-srgv"
server_key: "d1e7736359c90670dc04c4a0d4b458ba"
server_key_iv: "5280f12f4a6709d6645096dd23747b6e"
server_key_version: "encryptionkey@0"
I20260806 13:01:18.965991 22110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:18.990845 22110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:18.993726 22110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:18.993942 22110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:18.994277 22110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:18.994693 22110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:18.994747 22110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:18.994792 22110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:18.994836 22110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:19.002682 22110 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:34489
I20260806 13:01:19.002786 22243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:34489 every 8 connection(s)
I20260806 13:01:19.003244 22110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:19.008497 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 22110
I20260806 13:01:19.008659 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:19.008873 21462 external_mini_cluster.cc:1428] Setting key fbcd594973e32c5af62eee8afe9e7290
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021278, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:19.016955 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.004375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:51719 (local address 127.20.245.190:42791)
0806 13:01:19.004498 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.004501 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.004707 (+ 206us) server_negotiation.cc:407] Connection header received
0806 13:01:19.006219 (+ 1512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.006222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.006243 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.006307 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:19.007340 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.007990 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.009554 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.009901 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.009991 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.013135 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:19.013144 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:19.013144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:19.013154 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:19.014842 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.015450 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.015451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.015452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.015516 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.015837 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.015838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.015844 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.016028 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:19.016110 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.016629 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.016804 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 13:01:19.017072 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.004284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42791 (local address 127.20.245.129:51719)
0806 13:01:19.004522 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:19.004588 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:19.006008 (+ 1420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:19.006426 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:19.006431 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:19.006836 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:19.007125 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.007131 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.008124 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.008126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.009462 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.009466 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.010013 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.010013 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.010169 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.010930 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:19.010942 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:19.012995 (+ 2053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:19.014953 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:19.014965 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:19.014969 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:19.015350 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:19.015592 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:19.015593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:19.015593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:19.015737 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:19.016108 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:19.016119 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:19.016366 (+ 247us) client_negotiation.cc:769] Sending connection context
0806 13:01:19.016535 (+ 169us) client_negotiation.cc:240] Negotiation successful
0806 13:01:19.016774 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":112,"threads_started":1}
I20260806 13:01:19.018553 22244 heartbeater.cc:347] Connected to a master server at 127.20.245.190:42791
I20260806 13:01:19.018713 22244 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:19.019011 22244 heartbeater.cc:511] Master 127.20.245.190:42791 requested a full tablet report, sending...
I20260806 13:01:19.020012 22048 ts_manager.cc:194] Registered new tserver with Master: 3fb399c47cb84cce9c94202e6325b8af (127.20.245.129:34489)
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:01:19.021188 22048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:51719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:19.043740 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42791
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:37923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:19.144851 22249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:19.145175 22249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:19.145213 22249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:19.146656 22249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:19.146727 22249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:19.146760 22249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:19.148797 22249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:37923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:19.149163 22249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:19.149461 22249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:19.155915 22254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:19.155943 22257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:19.155947 22255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:19.155979 22249 server_base.cc:1034] running on GCE node
I20260806 13:01:19.156467 22249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:19.156801 22249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:19.158022 22249 hybrid_clock.cc:648] HybridClock initialized: now 1786021279157991 us; error 40 us; skew 500 ppm
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021279, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:19.161620 22249 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:19.162276 22249 webserver.cc:460] Webserver started at http://127.20.245.130:34909/ using document root <none> and password file <none>
I20260806 13:01:19.162606 22249 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:19.162662 22249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:19.162869 22249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:19.164340 22249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "98a89deaa94e48e5af9641c57889a28a"
format_stamp: "Formatted at 2026-08-06 13:01:19 on dist-test-slave-srgv"
server_key: "30e22d019e0bc47e22d048c1a2cd7b2b"
server_key_iv: "9259d0605d32bfdd56d2bd6bc3d28991"
server_key_version: "encryptionkey@0"
I20260806 13:01:19.164811 22249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "98a89deaa94e48e5af9641c57889a28a"
format_stamp: "Formatted at 2026-08-06 13:01:19 on dist-test-slave-srgv"
server_key: "30e22d019e0bc47e22d048c1a2cd7b2b"
server_key_iv: "9259d0605d32bfdd56d2bd6bc3d28991"
server_key_version: "encryptionkey@0"
I20260806 13:01:19.166628 22249 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 13:01:19.167721 22264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:19.168018 22249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:19.168140 22249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "98a89deaa94e48e5af9641c57889a28a"
format_stamp: "Formatted at 2026-08-06 13:01:19 on dist-test-slave-srgv"
server_key: "30e22d019e0bc47e22d048c1a2cd7b2b"
server_key_iv: "9259d0605d32bfdd56d2bd6bc3d28991"
server_key_version: "encryptionkey@0"
I20260806 13:01:19.168247 22249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:19.180593 22249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:19.183911 22249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:19.184109 22249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:19.184463 22249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:19.184914 22249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:19.184973 22249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:19.185025 22249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:19.185060 22249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:19.192863 22249 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:44737
I20260806 13:01:19.192948 22382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:44737 every 8 connection(s)
I20260806 13:01:19.193401 22249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:19.201490 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 22249
I20260806 13:01:19.201646 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:19.201887 21462 external_mini_cluster.cc:1428] Setting key 1ac8072bb421ee5408fa62eb88e75101
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021279, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:19.207026 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.194508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:36679 (local address 127.20.245.190:42791)
0806 13:01:19.194585 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.194588 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.194853 (+ 265us) server_negotiation.cc:407] Connection header received
0806 13:01:19.196253 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.196255 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.196273 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.196350 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:19.197316 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.197924 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.199286 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.199528 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.199607 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.203323 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:19.203326 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:19.203326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:19.203336 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:19.205086 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.205670 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.205672 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.205673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.205746 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.206117 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.206118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.206119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.206303 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:19.206383 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.206827 (+ 444us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.206937 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 13:01:19.207451 22385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.194447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42791 (local address 127.20.245.130:36679)
0806 13:01:19.194652 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:19.194709 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:19.196056 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:19.196442 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:19.196447 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:19.196851 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:19.197148 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.197154 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.198039 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.198040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.199084 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.199087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.199664 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.199665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.199844 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.200744 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:19.200758 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:19.203105 (+ 2347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:19.205209 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:19.205224 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:19.205229 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:19.205570 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:19.205829 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:19.205830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:19.205830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:19.206033 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:19.206390 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:19.206400 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:19.206649 (+ 249us) client_negotiation.cc:769] Sending connection context
0806 13:01:19.206791 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 13:01:19.207037 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":113,"threads_started":1}
I20260806 13:01:19.208056 22383 heartbeater.cc:347] Connected to a master server at 127.20.245.190:42791
I20260806 13:01:19.208189 22383 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:19.208464 22383 heartbeater.cc:511] Master 127.20.245.190:42791 requested a full tablet report, sending...
I20260806 13:01:19.208948 22048 ts_manager.cc:194] Registered new tserver with Master: 98a89deaa94e48e5af9641c57889a28a (127.20.245.130:44737)
I20260806 13:01:19.209422 22048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:36679
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:19.238442 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42791
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:37923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:19.344108 22388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:19.344471 22388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:19.344521 22388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:19.346180 22388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:19.346268 22388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:19.346324 22388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:19.348414 22388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:37923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:19.348851 22388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:19.349175 22388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:19.355953 22396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:19.356022 22394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:19.356020 22388 server_base.cc:1034] running on GCE node
W20260806 13:01:19.355978 22393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:19.356555 22388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:19.356916 22388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:19.358283 22388 hybrid_clock.cc:648] HybridClock initialized: now 1786021279358262 us; error 32 us; skew 500 ppm
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021279, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:19.361806 22388 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:19.362428 22388 webserver.cc:460] Webserver started at http://127.20.245.131:46505/ using document root <none> and password file <none>
I20260806 13:01:19.362767 22388 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:19.362828 22388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:19.362965 22388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:19.364500 22388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "46cde0a0382a48e49066a405ddfca771"
format_stamp: "Formatted at 2026-08-06 13:01:19 on dist-test-slave-srgv"
server_key: "dd6cdc96ad5cbf6fa0f6ed36315732e6"
server_key_iv: "030f18c5268ad4c4a7abf85142eef933"
server_key_version: "encryptionkey@0"
I20260806 13:01:19.364921 22388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "46cde0a0382a48e49066a405ddfca771"
format_stamp: "Formatted at 2026-08-06 13:01:19 on dist-test-slave-srgv"
server_key: "dd6cdc96ad5cbf6fa0f6ed36315732e6"
server_key_iv: "030f18c5268ad4c4a7abf85142eef933"
server_key_version: "encryptionkey@0"
I20260806 13:01:19.366731 22388 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:19.367934 22403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:19.368238 22388 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:19.368350 22388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "46cde0a0382a48e49066a405ddfca771"
format_stamp: "Formatted at 2026-08-06 13:01:19 on dist-test-slave-srgv"
server_key: "dd6cdc96ad5cbf6fa0f6ed36315732e6"
server_key_iv: "030f18c5268ad4c4a7abf85142eef933"
server_key_version: "encryptionkey@0"
I20260806 13:01:19.368429 22388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:19.389909 22388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:19.393188 22388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:19.393365 22388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:19.393661 22388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:19.394034 22388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:19.394073 22388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:19.394110 22388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:19.394125 22388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:19.407971 22388 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:39669
I20260806 13:01:19.408015 22521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:39669 every 8 connection(s)
I20260806 13:01:19.408558 22388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:19.416540 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 22388
I20260806 13:01:19.416666 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:19.416883 21462 external_mini_cluster.cc:1428] Setting key f746f6bc877695458adcc71c1b7d18cc
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021279, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:19.422341 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.409878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:38931 (local address 127.20.245.190:42791)
0806 13:01:19.409952 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.409955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.410361 (+ 406us) server_negotiation.cc:407] Connection header received
0806 13:01:19.411681 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.411683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.411701 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.411769 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:19.412675 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.413261 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.414407 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.414634 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.414728 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.418469 (+ 3741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:19.418471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:19.418471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:19.418481 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:19.420443 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.421074 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.421075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.421076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.421158 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.421487 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.421488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.421489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.421651 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:19.421735 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.422092 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.422213 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 13:01:19.422693 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.409837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42791 (local address 127.20.245.131:38931)
0806 13:01:19.410201 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:19.410251 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:19.411544 (+ 1293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:19.411881 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:19.411887 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:19.412260 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:19.412561 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.412566 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.413373 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.413374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.414303 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.414306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.414741 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.414742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.414890 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.415852 (+ 962us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:19.415865 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:19.418363 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:19.420561 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:19.420573 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:19.420576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:19.420923 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:19.421243 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:19.421245 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:19.421245 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:19.421411 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:19.421722 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:19.421731 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:19.421935 (+ 204us) client_negotiation.cc:769] Sending connection context
0806 13:01:19.422067 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 13:01:19.422299 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":188,"threads_started":1}
I20260806 13:01:19.423499 22522 heartbeater.cc:347] Connected to a master server at 127.20.245.190:42791
I20260806 13:01:19.423662 22522 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:19.423947 22522 heartbeater.cc:511] Master 127.20.245.190:42791 requested a full tablet report, sending...
I20260806 13:01:19.424530 22048 ts_manager.cc:194] Registered new tserver with Master: 46cde0a0382a48e49066a405ddfca771 (127.20.245.131:39669)
I20260806 13:01:19.425009 22048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:38931
I20260806 13:01:19.429106 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:01:19.438627 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.431556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49116 (local address 127.20.245.190:42791)
0806 13:01:19.431645 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.431648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.431726 (+ 78us) server_negotiation.cc:407] Connection header received
0806 13:01:19.431786 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.431787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.431798 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.431845 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:19.432440 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.432976 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.433782 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.433993 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.434053 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.435680 (+ 1627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:19.435681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:19.435682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:19.435703 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:19.437208 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.437616 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.437617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.437618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.437673 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.437909 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.437909 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.437910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.438094 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:19.438183 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.438436 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.438514 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 13:01:19.442442 22048 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:19.445178 22048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:19.454473 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.449255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:39669 (local address 127.0.0.1:49322)
0806 13:01:19.449727 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:19.449738 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:19.449795 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:19.450194 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:19.450198 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:19.450212 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:19.450726 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.450729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.452223 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.452224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.453181 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.453183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.454054 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.454055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.454130 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.454151 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 13:01:19.454249 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 13:01:19.454325 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":150,"threads_started":1}
I20260806 13:01:19.454537 22536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.449437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49322 (local address 127.20.245.131:39669)
0806 13:01:19.449997 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.450003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.450013 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:01:19.450064 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.450066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.450082 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.450177 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:19.450850 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.452083 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.453282 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.453969 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.454053 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.454119 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.454288 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.454395 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":162,"threads_started":1}
I20260806 13:01:19.454802 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.449190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34489 (local address 127.0.0.1:39888)
0806 13:01:19.449528 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:19.449586 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:19.449691 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:19.450704 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:19.450704 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:19.450707 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:19.450777 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.450778 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.452199 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.452200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.453557 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.453560 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.454546 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.454547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.454616 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.454621 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:19.454655 (+ 34us) client_negotiation.cc:240] Negotiation successful
0806 13:01:19.454710 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":5,"thread_start_us":117,"threads_started":1}
I20260806 13:01:19.455315 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.449396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39888 (local address 127.20.245.129:34489)
0806 13:01:19.450489 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.450493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.450505 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:19.450568 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.450570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.450589 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.450712 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:19.450853 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.452077 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.453663 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.454443 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.455005 (+ 562us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.455083 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.455114 (+ 31us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.455203 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1016,"thread_start_us":116,"threads_started":1}
I20260806 13:01:19.455811 22533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.449489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:44737 (local address 127.0.0.1:39768)
0806 13:01:19.449736 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:19.449751 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:19.449824 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:19.450388 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:19.450389 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:19.450392 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:19.450581 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.450585 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.451953 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.451955 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.453557 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.453560 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.455491 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.455509 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.455606 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.455611 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:19.455645 (+ 34us) client_negotiation.cc:240] Negotiation successful
0806 13:01:19.455704 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":30,"thread_start_us":164,"threads_started":1}
I20260806 13:01:19.456203 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.449928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39768 (local address 127.20.245.130:44737)
0806 13:01:19.450181 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.450186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.450200 (+ 14us) server_negotiation.cc:407] Connection header received
0806 13:01:19.450272 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.450275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.450293 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.450391 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:19.450679 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.451764 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.454177 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.455367 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.455957 (+ 590us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.456035 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.456064 (+ 29us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.456113 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":155,"threads_started":1}
I20260806 13:01:19.456414 22176 tablet_service.cc:1467] Processing CreateTablet for tablet 4046804eb4ad4e3ea492d2d5039b3a7b (DEFAULT_TABLE table=test-table [id=e2cf25c1b1d94ec681e2117c915a66a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:19.456416 22453 tablet_service.cc:1467] Processing CreateTablet for tablet 4046804eb4ad4e3ea492d2d5039b3a7b (DEFAULT_TABLE table=test-table [id=e2cf25c1b1d94ec681e2117c915a66a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:19.456944 22176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4046804eb4ad4e3ea492d2d5039b3a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:19.456944 22453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4046804eb4ad4e3ea492d2d5039b3a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:19.456957 22315 tablet_service.cc:1467] Processing CreateTablet for tablet 4046804eb4ad4e3ea492d2d5039b3a7b (DEFAULT_TABLE table=test-table [id=e2cf25c1b1d94ec681e2117c915a66a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:19.457327 22315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4046804eb4ad4e3ea492d2d5039b3a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:19.461288 22539 tablet_bootstrap.cc:492] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a: Bootstrap starting.
I20260806 13:01:19.462710 22540 tablet_bootstrap.cc:492] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771: Bootstrap starting.
I20260806 13:01:19.462728 22539 tablet_bootstrap.cc:654] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:19.463404 22542 tablet_bootstrap.cc:492] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af: Bootstrap starting.
I20260806 13:01:19.464105 22540 tablet_bootstrap.cc:654] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:19.464197 22539 log.cc:824] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:19.464454 22542 tablet_bootstrap.cc:654] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:19.465138 22540 log.cc:824] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:19.465411 22542 log.cc:824] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:19.465694 22539 tablet_bootstrap.cc:492] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a: No bootstrap required, opened a new log
I20260806 13:01:19.465793 22539 ts_tablet_manager.cc:1397] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260806 13:01:19.466064 22540 tablet_bootstrap.cc:492] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771: No bootstrap required, opened a new log
I20260806 13:01:19.466157 22540 ts_tablet_manager.cc:1397] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 13:01:19.466398 22542 tablet_bootstrap.cc:492] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af: No bootstrap required, opened a new log
I20260806 13:01:19.466485 22542 ts_tablet_manager.cc:1397] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 13:01:19.468549 22540 raft_consensus.cc:348] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.468780 22540 raft_consensus.cc:374] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:19.468828 22540 raft_consensus.cc:729] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46cde0a0382a48e49066a405ddfca771, State: Initialized, Role: FOLLOWER
I20260806 13:01:19.468971 22540 consensus_queue.cc:260] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.469359 22540 ts_tablet_manager.cc:1428] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 13:01:19.469246 22539 raft_consensus.cc:348] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.469641 22522 heartbeater.cc:503] Master 127.20.245.190:42791 was elected leader, sending a full tablet report...
I20260806 13:01:19.469488 22539 raft_consensus.cc:374] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:19.469717 22539 raft_consensus.cc:729] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a89deaa94e48e5af9641c57889a28a, State: Initialized, Role: FOLLOWER
I20260806 13:01:19.469892 22539 consensus_queue.cc:260] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.470212 22542 raft_consensus.cc:348] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.470456 22539 ts_tablet_manager.cc:1428] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260806 13:01:19.470490 22542 raft_consensus.cc:374] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:19.470533 22542 raft_consensus.cc:729] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb399c47cb84cce9c94202e6325b8af, State: Initialized, Role: FOLLOWER
I20260806 13:01:19.470606 22383 heartbeater.cc:503] Master 127.20.245.190:42791 was elected leader, sending a full tablet report...
I20260806 13:01:19.470661 22542 consensus_queue.cc:260] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.471230 22542 ts_tablet_manager.cc:1428] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260806 13:01:19.471411 22244 heartbeater.cc:503] Master 127.20.245.190:42791 was elected leader, sending a full tablet report...
W20260806 13:01:19.504339 22245 tablet.cc:2369] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:01:19.659530 22523 tablet.cc:2369] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:01:19.694430 22384 tablet.cc:2369] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:19.735042 22546 raft_consensus.cc:482] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:19.735297 22546 raft_consensus.cc:504] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.736003 22546 leader_election.cc:288] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fb399c47cb84cce9c94202e6325b8af (127.20.245.129:34489), 98a89deaa94e48e5af9641c57889a28a (127.20.245.130:44737)
I20260806 13:01:19.739790 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.736297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34489 (local address 127.20.245.131:60509)
0806 13:01:19.736373 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:19.736387 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:19.736449 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:19.736678 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:19.736679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:19.736682 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:19.736814 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.736817 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.737786 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.737787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.738621 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.738624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.739468 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.739469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.739562 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.739567 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:19.739633 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 13:01:19.739695 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 13:01:19.739799 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.736378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:60509 (local address 127.20.245.129:34489)
0806 13:01:19.736496 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.736498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.736513 (+ 15us) server_negotiation.cc:407] Connection header received
0806 13:01:19.736559 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.736560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.736572 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.736660 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:19.736901 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.737700 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.738725 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.739383 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.739461 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.739473 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.739645 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.739704 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 13:01:19.739991 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.736604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:57379 (local address 127.20.245.130:44737)
0806 13:01:19.736654 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.736657 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.736751 (+ 94us) server_negotiation.cc:407] Connection header received
0806 13:01:19.736809 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.736810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.736822 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.736884 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:19.737182 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.737774 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.739035 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.739615 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.739687 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.739695 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.739863 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.739914 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 13:01:19.740186 22549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.736452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:44737 (local address 127.20.245.131:57379)
0806 13:01:19.736667 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:19.736680 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:19.736753 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:19.736900 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:19.736901 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:19.736903 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:19.737102 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.737105 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.737858 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.737858 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.738893 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:19.738896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.739695 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.739696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:19.739775 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.739779 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:19.739843 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 13:01:19.740105 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":136,"threads_started":1}
I20260806 13:01:19.740528 22196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4046804eb4ad4e3ea492d2d5039b3a7b" candidate_uuid: "46cde0a0382a48e49066a405ddfca771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb399c47cb84cce9c94202e6325b8af" is_pre_election: true
I20260806 13:01:19.740751 22196 raft_consensus.cc:2454] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46cde0a0382a48e49066a405ddfca771 in term 0.
I20260806 13:01:19.741094 22335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4046804eb4ad4e3ea492d2d5039b3a7b" candidate_uuid: "46cde0a0382a48e49066a405ddfca771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a89deaa94e48e5af9641c57889a28a" is_pre_election: true
I20260806 13:01:19.741277 22335 raft_consensus.cc:2454] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46cde0a0382a48e49066a405ddfca771 in term 0.
I20260806 13:01:19.741089 22408 leader_election.cc:302] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fb399c47cb84cce9c94202e6325b8af, 46cde0a0382a48e49066a405ddfca771; no voters:
I20260806 13:01:19.741447 22546 raft_consensus.cc:2781] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:19.741504 22546 raft_consensus.cc:482] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:19.741521 22546 raft_consensus.cc:3037] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:19.742794 22546 raft_consensus.cc:504] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.742925 22546 leader_election.cc:288] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [CANDIDATE]: Term 1 election: Requested vote from peers 3fb399c47cb84cce9c94202e6325b8af (127.20.245.129:34489), 98a89deaa94e48e5af9641c57889a28a (127.20.245.130:44737)
I20260806 13:01:19.743312 22335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4046804eb4ad4e3ea492d2d5039b3a7b" candidate_uuid: "46cde0a0382a48e49066a405ddfca771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a89deaa94e48e5af9641c57889a28a"
I20260806 13:01:19.743305 22196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4046804eb4ad4e3ea492d2d5039b3a7b" candidate_uuid: "46cde0a0382a48e49066a405ddfca771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb399c47cb84cce9c94202e6325b8af"
I20260806 13:01:19.743399 22335 raft_consensus.cc:3037] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:19.743419 22196 raft_consensus.cc:3037] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:19.744549 22335 raft_consensus.cc:2454] T 4046804eb4ad4e3ea492d2d5039b3a7b P 98a89deaa94e48e5af9641c57889a28a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46cde0a0382a48e49066a405ddfca771 in term 1.
I20260806 13:01:19.744544 22196 raft_consensus.cc:2454] T 4046804eb4ad4e3ea492d2d5039b3a7b P 3fb399c47cb84cce9c94202e6325b8af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46cde0a0382a48e49066a405ddfca771 in term 1.
I20260806 13:01:19.744772 22408 leader_election.cc:302] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fb399c47cb84cce9c94202e6325b8af, 46cde0a0382a48e49066a405ddfca771; no voters:
I20260806 13:01:19.744892 22546 raft_consensus.cc:2781] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:19.745160 22546 raft_consensus.cc:686] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [term 1 LEADER]: Becoming Leader. State: Replica: 46cde0a0382a48e49066a405ddfca771, State: Running, Role: LEADER
I20260806 13:01:19.745299 22546 consensus_queue.cc:237] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } }
I20260806 13:01:19.746747 22048 catalog_manager.cc:5495] T 4046804eb4ad4e3ea492d2d5039b3a7b P 46cde0a0382a48e49066a405ddfca771 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46cde0a0382a48e49066a405ddfca771 (127.20.245.131). New cstate: current_term: 1 leader_uuid: "46cde0a0382a48e49066a405ddfca771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb399c47cb84cce9c94202e6325b8af" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98a89deaa94e48e5af9641c57889a28a" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46cde0a0382a48e49066a405ddfca771" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 39669 } health_report { overall_health: HEALTHY } } }
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:19.821635 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.811714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39904 (local address 127.20.245.129:34489)
0806 13:01:19.811837 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.811840 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.811980 (+ 140us) server_negotiation.cc:407] Connection header received
0806 13:01:19.812017 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.812018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.812032 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.812156 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:19.812889 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.813473 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.814323 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.814522 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.814584 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.817683 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:19.817709 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:19.817709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:19.817728 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:19.820077 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.820549 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.820556 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.820557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.820654 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.820883 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.820884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.820885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.821098 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:19.821320 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.821362 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.821476 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021279, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021279, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:19.852144 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.843700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39910 (local address 127.20.245.129:34489)
0806 13:01:19.843806 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.843808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.843856 (+ 48us) server_negotiation.cc:407] Connection header received
0806 13:01:19.843932 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.843934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.843947 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.844003 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:19.844750 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.845414 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.846234 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.846466 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.846546 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.849316 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:19.849318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:19.849319 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:19.849330 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:19.850962 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.851363 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.851364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.851365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.851425 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.851583 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.851584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.851584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.851692 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:19.851786 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.851936 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.852014 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:19.883939 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:19.875214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39912 (local address 127.20.245.129:34489)
0806 13:01:19.875290 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:19.875293 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:19.875383 (+ 90us) server_negotiation.cc:407] Connection header received
0806 13:01:19.875460 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:19.875461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:19.875473 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:19.875541 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:19.876216 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.876754 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.877551 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:19.877764 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:19.877839 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:19.880812 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:19.880815 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:19.880815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:19.880834 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:19.882515 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.882942 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.882943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.882944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.883013 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:19.883287 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:19.883288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:19.883289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:19.883417 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:19.883532 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:19.883701 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 13:01:19.883802 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260806 13:01:19.884850 22154 tablet_service.cc:2908] Rejecting scan request for tablet 4046804eb4ad4e3ea492d2d5039b3a7b: Uninitialized: clean time has not yet been initialized
I20260806 13:01:19.886327 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 22110
I20260806 13:01:19.893093 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 22249
I20260806 13:01:19.899647 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 22388
I20260806 13:01:19.905293 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 22014
2026-08-06T13:01:19Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2563 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22564](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22564](info): set up 2 sockets
Aug 06 13:01:19 dist-test-slave-srgv krb5kdc[22564](info): commencing operation
krb5kdc: starting...
W20260806 13:01:21.019101 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:21 dist-test-slave-srgv krb5kdc[22564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:21.167145 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:34903
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:34903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:21.264348 22577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:21.264649 22577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:21.264679 22577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:21.266161 22577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:21.266227 22577 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 13:01:21.266240 22577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:21.266254 22577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:21.266268 22577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:21.266280 22577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:21.268096 22577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:34903
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:34903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:21.268453 22577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:21.268761 22577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:21.274909 22585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:21.274928 22583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:21.274909 22582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:21.275388 22577 server_base.cc:1034] running on GCE node
I20260806 13:01:21.275725 22577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:21.276110 22577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:21.277369 22577 hybrid_clock.cc:648] HybridClock initialized: now 1786021281277351 us; error 31 us; skew 500 ppm
Aug 06 13:01:21 dist-test-slave-srgv krb5kdc[22564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021281, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:21.289068 22577 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:21.289858 22577 webserver.cc:460] Webserver started at http://127.20.245.190:38941/ using document root <none> and password file <none>
I20260806 13:01:21.290251 22577 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:21.290318 22577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:21.290508 22577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:21.292147 22577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "0a64d963ccb048a3b59d1be23251408d"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "5d9d4722d95e9eb83cb1ad85cecf43e1"
server_key_iv: "ff36cb40221cd5c5902e463ffaa77b52"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.292657 22577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "0a64d963ccb048a3b59d1be23251408d"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "5d9d4722d95e9eb83cb1ad85cecf43e1"
server_key_iv: "ff36cb40221cd5c5902e463ffaa77b52"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.294575 22577 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:21.295727 22592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:21.295946 22577 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:21.296069 22577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "0a64d963ccb048a3b59d1be23251408d"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "5d9d4722d95e9eb83cb1ad85cecf43e1"
server_key_iv: "ff36cb40221cd5c5902e463ffaa77b52"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.296159 22577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:21.309466 22577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:21.312103 22577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:21.312302 22577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:21.318720 22577 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:34903
I20260806 13:01:21.318778 22658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:34903 every 8 connection(s)
I20260806 13:01:21.319240 22577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:21.320065 22659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:21.323033 22659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d: Bootstrap starting.
I20260806 13:01:21.323835 22659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:21.324201 22659 log.cc:824] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:21.325035 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 22577
I20260806 13:01:21.325157 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:21.325228 22659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d: No bootstrap required, opened a new log
I20260806 13:01:21.325378 21462 external_mini_cluster.cc:1428] Setting key 77b76d08f374b492169b87afe4e569cb
I20260806 13:01:21.328590 22659 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a64d963ccb048a3b59d1be23251408d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34903 } }
I20260806 13:01:21.328801 22659 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:21.328856 22659 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a64d963ccb048a3b59d1be23251408d, State: Initialized, Role: FOLLOWER
I20260806 13:01:21.329114 22659 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a64d963ccb048a3b59d1be23251408d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34903 } }
I20260806 13:01:21.329232 22659 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:21.329270 22659 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:21.329324 22659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:21.330260 22659 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a64d963ccb048a3b59d1be23251408d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34903 } }
I20260806 13:01:21.330410 22659 leader_election.cc:302] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a64d963ccb048a3b59d1be23251408d; no voters:
I20260806 13:01:21.330638 22659 leader_election.cc:288] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:21.330751 22664 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:21.330973 22659 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:21.330984 22664 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [term 1 LEADER]: Becoming Leader. State: Replica: 0a64d963ccb048a3b59d1be23251408d, State: Running, Role: LEADER
I20260806 13:01:21.331349 22664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a64d963ccb048a3b59d1be23251408d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34903 } }
I20260806 13:01:21.331981 22666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a64d963ccb048a3b59d1be23251408d. Latest consensus state: current_term: 1 leader_uuid: "0a64d963ccb048a3b59d1be23251408d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a64d963ccb048a3b59d1be23251408d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34903 } } }
I20260806 13:01:21.332069 22666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:21.332372 22674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:21.333046 22665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a64d963ccb048a3b59d1be23251408d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a64d963ccb048a3b59d1be23251408d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34903 } } }
I20260806 13:01:21.333868 22665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:21.333134 22674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 13:01:21 dist-test-slave-srgv krb5kdc[22564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:21.335958 22674 catalog_manager.cc:1347] Generated new cluster ID: ae665327afbb46c984b94cf5520ab37c
I20260806 13:01:21.336014 22674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:21.339382 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.326054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37706 (local address 127.20.245.190:34903)
0806 13:01:21.326291 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:21.326307 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:21.326336 (+ 29us) server_negotiation.cc:407] Connection header received
0806 13:01:21.326886 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:21.326894 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:21.326959 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:21.327140 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:21.327898 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.328945 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.330182 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.330970 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.331134 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.335097 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:21.335102 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:21.335103 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:21.335118 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:21.337362 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.337822 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.337826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.337827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.337937 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.338176 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.338177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.338177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.338485 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:21.338697 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:21.338831 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 13:01:21.339025 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":120,"threads_started":1}
I20260806 13:01:21.356387 22674 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:21.357156 22674 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:21.361716 22674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d: Generated new TSK 0
I20260806 13:01:21.361979 22674 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:21.408039 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:34903
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:21.528919 22685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:21.529212 22685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:21.529244 22685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:21.530598 22685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:21.530647 22685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:21.530691 22685 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:21.530728 22685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:21.532559 22685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:34903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:21.532852 22685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:21.533102 22685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:21.539265 22695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:21.539338 22685 server_base.cc:1034] running on GCE node
W20260806 13:01:21.539327 22691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:21.539265 22692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:21.539796 22685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:21.540151 22685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:21.541370 22685 hybrid_clock.cc:648] HybridClock initialized: now 1786021281541344 us; error 47 us; skew 500 ppm
Aug 06 13:01:21 dist-test-slave-srgv krb5kdc[22564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021281, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:21.545348 22685 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:21.546252 22685 webserver.cc:460] Webserver started at http://127.20.245.129:41007/ using document root <none> and password file <none>
I20260806 13:01:21.546691 22685 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:21.546797 22685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:21.547030 22685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:21.548578 22685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "e0778f954b354010916c53f063d4799c"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "797309c078286e8561eff33624750728"
server_key_iv: "e53ff012bf6c90e3c82c6304e147e1df"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.549008 22685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "e0778f954b354010916c53f063d4799c"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "797309c078286e8561eff33624750728"
server_key_iv: "e53ff012bf6c90e3c82c6304e147e1df"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.550951 22685 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260806 13:01:21.552327 22702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:21.552675 22685 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:21.552778 22685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "e0778f954b354010916c53f063d4799c"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "797309c078286e8561eff33624750728"
server_key_iv: "e53ff012bf6c90e3c82c6304e147e1df"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.552870 22685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:21.572166 22685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:21.575284 22685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:21.575469 22685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:21.576182 22685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:21.576233 22685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:21.576261 22685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:21.576311 22685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 13:01:21 dist-test-slave-srgv krb5kdc[22564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021281, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:21.585731 22685 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:41741
I20260806 13:01:21.585819 22819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:41741 every 8 connection(s)
I20260806 13:01:21.586264 22685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:21.586716 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 22685
I20260806 13:01:21.586869 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:21.587086 21462 external_mini_cluster.cc:1428] Setting key 535923ea520244af4bc5d91c0e5f2d02
I20260806 13:01:21.590283 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.576884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:45799 (local address 127.20.245.190:34903)
0806 13:01:21.576984 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:21.576987 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:21.577218 (+ 231us) server_negotiation.cc:407] Connection header received
0806 13:01:21.577848 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:21.577850 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:21.577868 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:21.577972 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:21.579076 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.580200 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.581499 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.581896 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.581987 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.585994 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:21.585997 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:21.585998 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:21.586009 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:21.588457 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.589010 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.589011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.589012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.589089 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.589454 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.589455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.589455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.589609 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:21.589694 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:21.590039 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 13:01:21.590162 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 13:01:21.590540 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.576847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:34903 (local address 127.20.245.129:45799)
0806 13:01:21.577049 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:21.577102 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:21.577722 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:21.578083 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:21.578088 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:21.578522 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:21.578924 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:21.578935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.580344 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.580346 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:21.581360 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:21.581365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.582057 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.582058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:21.582320 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.583262 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:21.583276 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:21.585835 (+ 2559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:21.588580 (+ 2745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:21.588591 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:21.588595 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:21.588905 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:21.589167 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:21.589168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:21.589168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:21.589367 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:21.589695 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:21.589704 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:21.589879 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 13:01:21.590003 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 13:01:21.590232 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":114,"threads_started":1}
I20260806 13:01:21.591289 22820 heartbeater.cc:347] Connected to a master server at 127.20.245.190:34903
I20260806 13:01:21.591427 22820 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:21.591691 22820 heartbeater.cc:511] Master 127.20.245.190:34903 requested a full tablet report, sending...
I20260806 13:01:21.592451 22610 ts_manager.cc:194] Registered new tserver with Master: e0778f954b354010916c53f063d4799c (127.20.245.129:41741)
I20260806 13:01:21.593616 22610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:45799
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
I20260806 13:01:21.601434 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.594185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:53225 (local address 127.20.245.190:34903)
0806 13:01:21.594924 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:21.594926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:21.594935 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:01:21.594958 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:21.594959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:21.594969 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:21.595057 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:21.595544 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.596101 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.596849 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.597072 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.597152 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.598389 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:21.598391 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:21.598391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:21.598401 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:21.599969 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.600427 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.600429 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.600430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.600505 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.600757 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.600758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.600759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.600906 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:21.600983 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:21.601176 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 13:01:21.601292 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711}
I20260806 13:01:21.601938 22828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.594123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:34903 (local address 127.20.245.129:53225)
0806 13:01:21.594361 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:21.594376 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:21.594447 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:21.595067 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:21.595068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:21.595367 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:21.595447 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:21.595450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.596209 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.596211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:21.596757 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:21.596759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.597150 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.597151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:21.597247 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.597888 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:21.597893 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:21.598230 (+ 337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:21.600057 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:21.600059 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:21.600060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:21.600273 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:21.600579 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:21.600580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:21.600580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:21.600650 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:21.600983 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:21.600985 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:21.601049 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 13:01:21.601586 (+ 537us) client_negotiation.cc:240] Negotiation successful
0806 13:01:21.601773 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":122,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:21.623510 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:34903
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:21.725718 22830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:21.726080 22830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:21.726128 22830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:21.727634 22830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:21.727703 22830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:21.727739 22830 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:21.727780 22830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:21.729410 22830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:34903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:21.729740 22830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:21.730032 22830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:01:21.736605 22830 server_base.cc:1034] running on GCE node
W20260806 13:01:21.736634 22837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:21.736865 22839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:21.736634 22836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:21.737149 22830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:21.737468 22830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:21.738668 22830 hybrid_clock.cc:648] HybridClock initialized: now 1786021281738645 us; error 43 us; skew 500 ppm
Aug 06 13:01:21 dist-test-slave-srgv krb5kdc[22564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021281, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:21.741808 22830 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:21.742405 22830 webserver.cc:460] Webserver started at http://127.20.245.130:37151/ using document root <none> and password file <none>
I20260806 13:01:21.742683 22830 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:21.742734 22830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:21.742921 22830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:21.744304 22830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "d1177621307546b0bae40bfcb1e839eb"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "7db9d3b234ca693a493140d4156c9f28"
server_key_iv: "2d552c8adb39184ef04e68a838de0f50"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.744787 22830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "d1177621307546b0bae40bfcb1e839eb"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "7db9d3b234ca693a493140d4156c9f28"
server_key_iv: "2d552c8adb39184ef04e68a838de0f50"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.746485 22830 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 13:01:21.747623 22846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:21.747943 22830 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:21.748059 22830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "d1177621307546b0bae40bfcb1e839eb"
format_stamp: "Formatted at 2026-08-06 13:01:21 on dist-test-slave-srgv"
server_key: "7db9d3b234ca693a493140d4156c9f28"
server_key_iv: "2d552c8adb39184ef04e68a838de0f50"
server_key_version: "encryptionkey@0"
I20260806 13:01:21.748154 22830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:21.759855 22830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:21.762956 22830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:21.763176 22830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:21.764070 22830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:21.764122 22830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:21.764149 22830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:21.764163 22830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 13:01:21 dist-test-slave-srgv krb5kdc[22564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021281, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:21.775885 22830 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:40593
I20260806 13:01:21.776013 22963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:40593 every 8 connection(s)
I20260806 13:01:21.776607 22830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:21.780359 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.764656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:46259 (local address 127.20.245.190:34903)
0806 13:01:21.764746 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:21.764750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:21.765183 (+ 433us) server_negotiation.cc:407] Connection header received
0806 13:01:21.766266 (+ 1083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:21.766268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:21.766291 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:21.766420 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:21.767796 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.768379 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.770397 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.770683 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.770785 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.775904 (+ 5119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:21.775907 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:21.775908 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:21.775920 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:21.778306 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.778913 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.778915 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.778915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.779040 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.779359 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.779360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.779360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.779516 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:21.779610 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:21.779932 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 13:01:21.780043 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 13:01:21.780776 22855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.764695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:34903 (local address 127.20.245.130:46259)
0806 13:01:21.764933 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:21.765002 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:21.765987 (+ 985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:21.766583 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:21.766590 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:21.767151 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:21.767645 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:21.767654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.768499 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.768500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:21.770242 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:21.770246 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.770799 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.770801 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:21.771035 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.773136 (+ 2101us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:21.773150 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:21.775750 (+ 2600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:21.778421 (+ 2671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:21.778431 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:21.778434 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:21.778819 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:21.779112 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:21.779113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:21.779113 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:21.779289 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:21.779599 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:21.779607 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:21.779783 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 13:01:21.779899 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 13:01:21.780263 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":119,"threads_started":1}
I20260806 13:01:21.781786 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 22830
I20260806 13:01:21.781930 22964 heartbeater.cc:347] Connected to a master server at 127.20.245.190:34903
I20260806 13:01:21.781965 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:21.782047 22964 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:21.782209 21462 external_mini_cluster.cc:1428] Setting key 5793f9981ee04310631b6afe3f46b502
I20260806 13:01:21.782349 22964 heartbeater.cc:511] Master 127.20.245.190:34903 requested a full tablet report, sending...
I20260806 13:01:21.782898 22608 ts_manager.cc:194] Registered new tserver with Master: d1177621307546b0bae40bfcb1e839eb (127.20.245.130:40593)
I20260806 13:01:21.783859 22608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:46259
I20260806 13:01:21.793507 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.784233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:34903 (local address 127.20.245.130:56577)
0806 13:01:21.784441 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:21.784454 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:21.784578 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:21.784738 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:21.784739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:21.785002 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:21.785084 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:21.785087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.785972 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.785973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:21.786729 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:21.786732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.787320 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.787321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:21.787496 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.788243 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:21.788250 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:21.788983 (+ 733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:21.791337 (+ 2354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:21.791338 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:21.791339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:21.791793 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:21.792042 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:21.792043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:21.792044 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:21.792137 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:21.792727 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:21.792728 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:21.792810 (+ 82us) client_negotiation.cc:769] Sending connection context
0806 13:01:21.792894 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 13:01:21.793153 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":124,"threads_started":1}
I20260806 13:01:21.793496 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:21.784300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:56577 (local address 127.20.245.190:34903)
0806 13:01:21.784350 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:21.784353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:21.784525 (+ 172us) server_negotiation.cc:407] Connection header received
0806 13:01:21.784657 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:21.784658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:21.784670 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:21.784733 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:21.785218 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.785856 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.786846 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:21.787157 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:21.787320 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:21.789136 (+ 1816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:21.789137 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:21.789138 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:21.789147 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:21.791143 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.791884 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.791886 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.791886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.791950 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:21.792243 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:21.792244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:21.792244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:21.792504 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:21.792713 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:21.792954 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 13:01:21.793163 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:21.824455 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:34903
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:21.995339 22973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:21.995687 22973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:21.995743 22973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:21.999550 22973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:21.999644 22973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:21.999676 22973 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:21.999718 22973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:22.002019 22973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:34903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:22.002430 22973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:22.002774 22973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:22.012535 22980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:22.012540 22979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:22.012535 22982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:22.013099 22973 server_base.cc:1034] running on GCE node
I20260806 13:01:22.013715 22973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:22.014272 22973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:22.015507 22973 hybrid_clock.cc:648] HybridClock initialized: now 1786021282015454 us; error 88 us; skew 500 ppm
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[22564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021282, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:22.022080 22973 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:22.023064 22973 webserver.cc:460] Webserver started at http://127.20.245.131:44391/ using document root <none> and password file <none>
I20260806 13:01:22.023573 22973 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:22.023684 22973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:22.023952 22973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:22.027632 22973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "0812f35ce4d74dcc93378f3f45ebec07"
format_stamp: "Formatted at 2026-08-06 13:01:22 on dist-test-slave-srgv"
server_key: "ed1762ce328e53b15bda4def01894ce3"
server_key_iv: "55fbd8c526704cfc01eaedc08ca88be8"
server_key_version: "encryptionkey@0"
I20260806 13:01:22.028688 22973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "0812f35ce4d74dcc93378f3f45ebec07"
format_stamp: "Formatted at 2026-08-06 13:01:22 on dist-test-slave-srgv"
server_key: "ed1762ce328e53b15bda4def01894ce3"
server_key_iv: "55fbd8c526704cfc01eaedc08ca88be8"
server_key_version: "encryptionkey@0"
I20260806 13:01:22.033769 22973 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 13:01:22.036329 22989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:22.036640 22973 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:22.036791 22973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "0812f35ce4d74dcc93378f3f45ebec07"
format_stamp: "Formatted at 2026-08-06 13:01:22 on dist-test-slave-srgv"
server_key: "ed1762ce328e53b15bda4def01894ce3"
server_key_iv: "55fbd8c526704cfc01eaedc08ca88be8"
server_key_version: "encryptionkey@0"
I20260806 13:01:22.036924 22973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:22.072017 22973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:22.074877 22973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:22.075095 22973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:22.075855 22973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:22.075927 22973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:22.075976 22973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:22.076002 22973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[22564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021282, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:22.085320 22973 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:40529
I20260806 13:01:22.085395 23105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:40529 every 8 connection(s)
I20260806 13:01:22.085886 22973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:22.088106 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 22973
I20260806 13:01:22.088218 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:22.088419 21462 external_mini_cluster.cc:1428] Setting key c73d48e418a4799b71f067c52ba366c9
I20260806 13:01:22.088694 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.076480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:51515 (local address 127.20.245.190:34903)
0806 13:01:22.076569 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.076572 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.076813 (+ 241us) server_negotiation.cc:407] Connection header received
0806 13:01:22.077427 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.077428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.077449 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.077540 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:22.078679 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.079720 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.080950 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.081348 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.081448 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.085148 (+ 3700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:22.085151 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:22.085151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:22.085164 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:22.087043 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.087550 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.087552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.087552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.087629 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.087912 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.087914 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.087914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.088071 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:22.088150 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.088477 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.088582 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 13:01:22.088949 22998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.076440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:34903 (local address 127.20.245.131:51515)
0806 13:01:22.076621 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.076675 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.077296 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.077676 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.077681 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.078146 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:22.078539 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.078547 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.079849 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.079850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.080827 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.080831 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.081499 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.081500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.081665 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.082526 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:22.082541 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:22.085002 (+ 2461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:22.087162 (+ 2160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:22.087189 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:22.087192 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:22.087461 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:22.087700 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:22.087701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:22.087701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:22.087834 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:22.088136 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:22.088144 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:22.088329 (+ 185us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.088455 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.088663 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260806 13:01:22.089519 23106 heartbeater.cc:347] Connected to a master server at 127.20.245.190:34903
I20260806 13:01:22.089635 23106 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:22.089864 23106 heartbeater.cc:511] Master 127.20.245.190:34903 requested a full tablet report, sending...
I20260806 13:01:22.090353 22610 ts_manager.cc:194] Registered new tserver with Master: 0812f35ce4d74dcc93378f3f45ebec07 (127.20.245.131:40529)
I20260806 13:01:22.090924 22610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:51515
I20260806 13:01:22.097144 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.091044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:54911 (local address 127.20.245.190:34903)
0806 13:01:22.091082 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.091084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.091104 (+ 20us) server_negotiation.cc:407] Connection header received
0806 13:01:22.091126 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.091127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.091136 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.091336 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:22.091756 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.092346 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.093084 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.093313 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.093398 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.094430 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:22.094432 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:22.094432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:22.094440 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:22.095845 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.096217 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.096219 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.096219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.096286 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.096516 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.096516 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.096517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.096647 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:22.096724 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.096937 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.097027 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 13:01:22.097157 23112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.090810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:34903 (local address 127.20.245.131:54911)
0806 13:01:22.090997 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.091008 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.091072 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.091344 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.091346 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.091552 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:22.091635 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.091637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.092444 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.092445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.092996 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.092998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.093400 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.093401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.093484 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.093998 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:22.094003 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:22.094331 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:22.095947 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:22.095949 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:22.095949 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:22.096137 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:22.096357 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:22.096358 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:22.096359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:22.096446 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:22.096718 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:22.096719 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:22.096775 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.096898 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.097028 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":117,"threads_started":1}
I20260806 13:01:22.100481 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[22564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021282, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[22564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021282, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:22.128747 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.120558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37708 (local address 127.20.245.190:34903)
0806 13:01:22.120633 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.120635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.120645 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:01:22.120684 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.120685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.120696 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.120768 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:22.121436 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.122004 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.122833 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.123035 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.123115 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.125858 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:22.125860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:22.125861 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:22.125875 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:22.127520 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.127882 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.127884 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.127885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.127947 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.128148 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.128149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.128150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.128299 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:22.128416 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.128524 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.128619 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 13:01:22.130955 22610 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:22.133379 22610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:22.141623 23126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.136480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:41741 (local address 127.0.0.1:45330)
0806 13:01:22.136884 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.136896 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.136955 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.137405 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.137409 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.137412 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:22.137536 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.137539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.138996 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.138997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.140081 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.140082 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.141115 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.141116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.141234 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.141255 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.141344 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.141422 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":2,"spinlock_wait_cycles":896,"thread_start_us":120,"threads_started":1}
I20260806 13:01:22.141767 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.136736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48842 (local address 127.20.245.131:40529)
0806 13:01:22.137281 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.137285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.137297 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:22.137342 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.137345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.137361 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.137615 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:22.137674 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.138422 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.140013 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.140957 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.141101 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.141186 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.141488 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.141635 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":142,"threads_started":1}
I20260806 13:01:22.141918 23124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.136479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:40529 (local address 127.0.0.1:48842)
0806 13:01:22.136720 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.136809 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.136897 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.137474 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.137475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.137477 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:22.137539 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.137541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.138517 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.138518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.139921 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.139924 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.141219 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.141221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.141301 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.141305 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.141378 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.141432 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":101,"threads_started":1}
I20260806 13:01:22.141546 23129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.137031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45330 (local address 127.20.245.129:41741)
0806 13:01:22.137180 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.137185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.137196 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:22.137244 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.137248 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.137270 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.137629 (+ 359us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:22.137714 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.138895 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.140163 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.141029 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.141112 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.141186 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.141375 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.141433 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260806 13:01:22.142724 23039 tablet_service.cc:1467] Processing CreateTablet for tablet 15ac333bbc824334b2c00782c1c7bd17 (DEFAULT_TABLE table=test-table [id=0aaa58fdf98b423a8250e5c6fc53cec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:22.142711 22752 tablet_service.cc:1467] Processing CreateTablet for tablet 15ac333bbc824334b2c00782c1c7bd17 (DEFAULT_TABLE table=test-table [id=0aaa58fdf98b423a8250e5c6fc53cec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:22.143163 23039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15ac333bbc824334b2c00782c1c7bd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.143217 22752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15ac333bbc824334b2c00782c1c7bd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.146526 23130 tablet_bootstrap.cc:492] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Bootstrap starting.
I20260806 13:01:22.147440 23125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.136502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:40593 (local address 127.0.0.1:52904)
0806 13:01:22.137237 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.137247 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.137324 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.137639 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.137640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.137642 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:22.137680 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.137681 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.140155 (+ 2474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.140155 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.140985 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.140987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.147069 (+ 6082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.147085 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.147212 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.147221 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.147289 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.147364 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":114,"threads_started":1}
I20260806 13:01:22.147531 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.136910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52904 (local address 127.20.245.130:40593)
0806 13:01:22.137117 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.137124 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.137388 (+ 264us) server_negotiation.cc:407] Connection header received
0806 13:01:22.137440 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.137442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.137459 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.137537 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:22.137764 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.138907 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.141109 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.146946 (+ 5837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.147081 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.147161 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.147324 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.147384 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":118,"threads_started":1}
I20260806 13:01:22.147621 23130 tablet_bootstrap.cc:654] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.148027 23130 log.cc:824] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:22.148507 23131 tablet_bootstrap.cc:492] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Bootstrap starting.
I20260806 13:01:22.148483 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 15ac333bbc824334b2c00782c1c7bd17 (DEFAULT_TABLE table=test-table [id=0aaa58fdf98b423a8250e5c6fc53cec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:22.148922 22896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15ac333bbc824334b2c00782c1c7bd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.149583 23131 tablet_bootstrap.cc:654] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.149948 23131 log.cc:824] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:22.150602 23130 tablet_bootstrap.cc:492] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: No bootstrap required, opened a new log
I20260806 13:01:22.150712 23130 ts_tablet_manager.cc:1397] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 13:01:22.151023 23131 tablet_bootstrap.cc:492] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: No bootstrap required, opened a new log
I20260806 13:01:22.151100 23131 ts_tablet_manager.cc:1397] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:01:22.153805 23131 raft_consensus.cc:348] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.153928 23130 raft_consensus.cc:348] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.154042 23131 raft_consensus.cc:374] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.154078 23130 raft_consensus.cc:374] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.154085 23131 raft_consensus.cc:729] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0812f35ce4d74dcc93378f3f45ebec07, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.154114 23130 raft_consensus.cc:729] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0778f954b354010916c53f063d4799c, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.154276 23130 consensus_queue.cc:260] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.154277 23131 consensus_queue.cc:260] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.154590 23130 ts_tablet_manager.cc:1428] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260806 13:01:22.154590 23131 ts_tablet_manager.cc:1428] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260806 13:01:22.153290 23134 tablet_bootstrap.cc:492] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Bootstrap starting.
I20260806 13:01:22.154747 22820 heartbeater.cc:503] Master 127.20.245.190:34903 was elected leader, sending a full tablet report...
I20260806 13:01:22.155104 23106 heartbeater.cc:503] Master 127.20.245.190:34903 was elected leader, sending a full tablet report...
I20260806 13:01:22.155551 23134 tablet_bootstrap.cc:654] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.156013 23134 log.cc:824] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:22.157076 23134 tablet_bootstrap.cc:492] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: No bootstrap required, opened a new log
I20260806 13:01:22.157168 23134 ts_tablet_manager.cc:1397] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 13:01:22.159227 23134 raft_consensus.cc:348] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.159464 23134 raft_consensus.cc:374] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.159515 23134 raft_consensus.cc:729] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1177621307546b0bae40bfcb1e839eb, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.159663 23134 consensus_queue.cc:260] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.159996 23134 ts_tablet_manager.cc:1428] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:01:22.160164 22964 heartbeater.cc:503] Master 127.20.245.190:34903 was elected leader, sending a full tablet report...
W20260806 13:01:22.277667 22965 tablet.cc:2369] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:01:22.336869 23107 tablet.cc:2369] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:01:22.337618 22822 tablet.cc:2369] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:22.464443 23136 raft_consensus.cc:482] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:22.464639 23136 raft_consensus.cc:504] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.465270 23136 leader_election.cc:288] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0778f954b354010916c53f063d4799c (127.20.245.129:41741), d1177621307546b0bae40bfcb1e839eb (127.20.245.130:40593)
I20260806 13:01:22.468854 23141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.465595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:40593 (local address 127.20.245.131:41275)
0806 13:01:22.465937 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.465948 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.466030 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.466253 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.466254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.466256 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:22.466344 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.466346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.467066 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.467067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.467966 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.467969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.468569 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.468570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.468672 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.468677 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.468721 (+ 44us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.468758 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":111,"thread_start_us":144,"threads_started":1}
I20260806 13:01:22.468879 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.465657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:41275 (local address 127.20.245.130:40593)
0806 13:01:22.465726 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.465729 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.466041 (+ 312us) server_negotiation.cc:407] Connection header received
0806 13:01:22.466156 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.466157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.466172 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.466239 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:22.466441 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.466981 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.468097 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.468478 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.468539 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.468548 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.468748 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.468794 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 13:01:22.469542 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15ac333bbc824334b2c00782c1c7bd17" candidate_uuid: "0812f35ce4d74dcc93378f3f45ebec07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1177621307546b0bae40bfcb1e839eb" is_pre_election: true
I20260806 13:01:22.469729 22998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.465593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:41741 (local address 127.20.245.131:47061)
0806 13:01:22.465673 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.465689 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.465757 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.465970 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.465971 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.465973 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:22.466087 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.466090 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.466939 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.466940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.467933 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.467936 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.468610 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.468611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.469524 (+ 913us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.469530 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.469598 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.469646 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":26}
I20260806 13:01:22.469779 22916 raft_consensus.cc:2454] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0812f35ce4d74dcc93378f3f45ebec07 in term 0.
I20260806 13:01:22.469821 23129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.465666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:47061 (local address 127.20.245.129:41741)
0806 13:01:22.465752 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.465755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.465768 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:01:22.465869 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.465870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.465883 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.465956 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:22.466175 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.466843 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.468047 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.468498 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.468601 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.468611 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.469643 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.469737 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 13:01:22.470105 22992 leader_election.cc:302] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812f35ce4d74dcc93378f3f45ebec07, d1177621307546b0bae40bfcb1e839eb; no voters:
I20260806 13:01:22.470141 22772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15ac333bbc824334b2c00782c1c7bd17" candidate_uuid: "0812f35ce4d74dcc93378f3f45ebec07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0778f954b354010916c53f063d4799c" is_pre_election: true
I20260806 13:01:22.470311 22772 raft_consensus.cc:2454] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0812f35ce4d74dcc93378f3f45ebec07 in term 0.
I20260806 13:01:22.470309 23136 raft_consensus.cc:2781] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:22.470417 23136 raft_consensus.cc:482] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:22.470458 23136 raft_consensus.cc:3037] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.471477 23136 raft_consensus.cc:504] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.471680 23136 leader_election.cc:288] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [CANDIDATE]: Term 1 election: Requested vote from peers e0778f954b354010916c53f063d4799c (127.20.245.129:41741), d1177621307546b0bae40bfcb1e839eb (127.20.245.130:40593)
I20260806 13:01:22.471886 22772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15ac333bbc824334b2c00782c1c7bd17" candidate_uuid: "0812f35ce4d74dcc93378f3f45ebec07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0778f954b354010916c53f063d4799c"
I20260806 13:01:22.471978 22772 raft_consensus.cc:3037] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.472970 22772 raft_consensus.cc:2454] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0812f35ce4d74dcc93378f3f45ebec07 in term 1.
I20260806 13:01:22.473121 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15ac333bbc824334b2c00782c1c7bd17" candidate_uuid: "0812f35ce4d74dcc93378f3f45ebec07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1177621307546b0bae40bfcb1e839eb"
I20260806 13:01:22.473205 22990 leader_election.cc:302] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812f35ce4d74dcc93378f3f45ebec07, e0778f954b354010916c53f063d4799c; no voters:
I20260806 13:01:22.473237 22916 raft_consensus.cc:3037] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.473342 23136 raft_consensus.cc:2781] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:22.473562 23136 raft_consensus.cc:686] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 LEADER]: Becoming Leader. State: Replica: 0812f35ce4d74dcc93378f3f45ebec07, State: Running, Role: LEADER
I20260806 13:01:22.473680 23136 consensus_queue.cc:237] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } }
I20260806 13:01:22.474493 22916 raft_consensus.cc:2454] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0812f35ce4d74dcc93378f3f45ebec07 in term 1.
I20260806 13:01:22.474885 22608 catalog_manager.cc:5495] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0812f35ce4d74dcc93378f3f45ebec07 (127.20.245.131). New cstate: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:22.500523 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.497160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48850 (local address 127.20.245.131:40529)
0806 13:01:22.497236 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.497238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.497316 (+ 78us) server_negotiation.cc:407] Connection header received
0806 13:01:22.497435 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.497436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.497460 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.497529 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:22.497781 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.498389 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.499415 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.499642 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.499714 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.500057 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:22.500196 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:22.500336 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.500381 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.500408 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 13:01:22.503743 22916 raft_consensus.cc:1261] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Refusing update from remote peer 0812f35ce4d74dcc93378f3f45ebec07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:22.503743 22772 raft_consensus.cc:1261] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Refusing update from remote peer 0812f35ce4d74dcc93378f3f45ebec07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:22.504402 23136 consensus_queue.cc:1035] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:22.504648 23142 consensus_queue.cc:1035] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:22.510740 23148 mvcc.cc:205] Tried to move back new op lower bound from 7315543173129383936 to 7315543173012787200. Current Snapshot: MvccSnapshot[applied={T|T < 7315543173129383936}]
I20260806 13:01:22.515740 22610 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:22.515928 22610 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:22.517316 22610 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d: Sending DeleteTablet for 3 replicas of tablet 15ac333bbc824334b2c00782c1c7bd17
I20260806 13:01:22.518080 22752 tablet_service.cc:1514] Processing DeleteTablet for tablet 15ac333bbc824334b2c00782c1c7bd17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:22 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:45330
I20260806 13:01:22.518198 22610 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:22.518450 22610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:22.519901 23039 tablet_service.cc:1514] Processing DeleteTablet for tablet 15ac333bbc824334b2c00782c1c7bd17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:22 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:48842
I20260806 13:01:22.520556 22752 tablet_service.cc:1467] Processing CreateTablet for tablet 9f64bd26b4ef4b87aeabbb457ff2254f (DEFAULT_TABLE table=test-table [id=8cabfec0d2554d558675bac6a2fdb399]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:22.520596 22896 tablet_service.cc:1514] Processing DeleteTablet for tablet 15ac333bbc824334b2c00782c1c7bd17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:22 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:52904
I20260806 13:01:22.520692 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 9f64bd26b4ef4b87aeabbb457ff2254f (DEFAULT_TABLE table=test-table [id=8cabfec0d2554d558675bac6a2fdb399]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:22.520758 22752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f64bd26b4ef4b87aeabbb457ff2254f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.520866 22895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f64bd26b4ef4b87aeabbb457ff2254f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.521045 23156 tablet_replica.cc:330] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: stopping tablet replica
I20260806 13:01:22.521227 23156 raft_consensus.cc:2229] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:22.521481 23156 raft_consensus.cc:2258] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:22.522277 23156 ts_tablet_manager.cc:1905] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:22.522924 23130 tablet_bootstrap.cc:492] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: Bootstrap starting.
I20260806 13:01:22.523131 23134 tablet_bootstrap.cc:492] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: Bootstrap starting.
I20260806 13:01:22.523259 23039 tablet_service.cc:1467] Processing CreateTablet for tablet 9f64bd26b4ef4b87aeabbb457ff2254f (DEFAULT_TABLE table=test-table [id=8cabfec0d2554d558675bac6a2fdb399]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:22.523465 23039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f64bd26b4ef4b87aeabbb457ff2254f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.524219 23134 tablet_bootstrap.cc:654] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.524219 23130 tablet_bootstrap.cc:654] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.525210 23131 tablet_bootstrap.cc:492] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: Bootstrap starting.
I20260806 13:01:22.526152 23134 tablet_bootstrap.cc:492] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: No bootstrap required, opened a new log
I20260806 13:01:22.526206 23131 tablet_bootstrap.cc:654] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.526221 23134 ts_tablet_manager.cc:1397] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:01:22.526468 23134 raft_consensus.cc:348] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.526569 23134 raft_consensus.cc:374] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.526597 23134 raft_consensus.cc:729] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1177621307546b0bae40bfcb1e839eb, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.526655 23134 consensus_queue.cc:260] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.526787 23134 ts_tablet_manager.cc:1428] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:22.527165 23157 tablet_replica.cc:330] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: stopping tablet replica
I20260806 13:01:22.527962 23131 tablet_bootstrap.cc:492] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: No bootstrap required, opened a new log
I20260806 13:01:22.528024 23131 ts_tablet_manager.cc:1397] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 13:01:22.528352 23157 raft_consensus.cc:2229] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:22.528537 23157 raft_consensus.cc:2258] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:22.528687 23156 ts_tablet_manager.cc:1918] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:22.528834 23156 log.cc:1196] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/15ac333bbc824334b2c00782c1c7bd17
I20260806 13:01:22.528959 23131 raft_consensus.cc:348] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.529086 23131 raft_consensus.cc:374] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.529116 23131 raft_consensus.cc:729] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0812f35ce4d74dcc93378f3f45ebec07, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.529182 23131 consensus_queue.cc:260] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.529207 23157 ts_tablet_manager.cc:1905] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:22.529320 23131 ts_tablet_manager.cc:1428] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:22.529703 23156 ts_tablet_manager.cc:1939] T 15ac333bbc824334b2c00782c1c7bd17 P 0812f35ce4d74dcc93378f3f45ebec07: Deleting consensus metadata
I20260806 13:01:22.530428 22597 catalog_manager.cc:4841] TS 0812f35ce4d74dcc93378f3f45ebec07 (127.20.245.131:40529): tablet 15ac333bbc824334b2c00782c1c7bd17 (table test-table [id=0aaa58fdf98b423a8250e5c6fc53cec4]) successfully deleted
I20260806 13:01:22.530573 23130 tablet_bootstrap.cc:492] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: No bootstrap required, opened a new log
I20260806 13:01:22.530644 23130 ts_tablet_manager.cc:1397] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260806 13:01:22.530897 23155 tablet_replica.cc:330] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: stopping tablet replica
I20260806 13:01:22.531090 23155 raft_consensus.cc:2229] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:22.531051 23130 raft_consensus.cc:348] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.531140 23130 raft_consensus.cc:374] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.531162 23130 raft_consensus.cc:729] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0778f954b354010916c53f063d4799c, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.531252 23155 raft_consensus.cc:2258] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:22.531280 23130 consensus_queue.cc:260] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.531492 23130 ts_tablet_manager.cc:1428] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:22.531986 23155 ts_tablet_manager.cc:1905] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:22.534822 23157 ts_tablet_manager.cc:1918] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:22.534822 23155 ts_tablet_manager.cc:1918] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:22.534937 23157 log.cc:1196] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/15ac333bbc824334b2c00782c1c7bd17
I20260806 13:01:22.534938 23155 log.cc:1196] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/15ac333bbc824334b2c00782c1c7bd17
I20260806 13:01:22.535300 23155 ts_tablet_manager.cc:1939] T 15ac333bbc824334b2c00782c1c7bd17 P e0778f954b354010916c53f063d4799c: Deleting consensus metadata
I20260806 13:01:22.535336 23157 ts_tablet_manager.cc:1939] T 15ac333bbc824334b2c00782c1c7bd17 P d1177621307546b0bae40bfcb1e839eb: Deleting consensus metadata
I20260806 13:01:22.536042 22593 catalog_manager.cc:4841] TS e0778f954b354010916c53f063d4799c (127.20.245.129:41741): tablet 15ac333bbc824334b2c00782c1c7bd17 (table test-table [id=0aaa58fdf98b423a8250e5c6fc53cec4]) successfully deleted
I20260806 13:01:22.536172 22596 catalog_manager.cc:4841] TS d1177621307546b0bae40bfcb1e839eb (127.20.245.130:40593): tablet 15ac333bbc824334b2c00782c1c7bd17 (table test-table [id=0aaa58fdf98b423a8250e5c6fc53cec4]) successfully deleted
I20260806 13:01:22.557832 23139 raft_consensus.cc:482] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:22.557981 23139 raft_consensus.cc:504] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.558499 23139 leader_election.cc:288] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0778f954b354010916c53f063d4799c (127.20.245.129:41741), 0812f35ce4d74dcc93378f3f45ebec07 (127.20.245.131:40529)
I20260806 13:01:22.563021 23162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.558755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:40529 (local address 127.20.245.130:44231)
0806 13:01:22.558929 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.558942 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.559053 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.559273 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.559274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.559276 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:22.559386 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.559389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.560435 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.560436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.561931 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.561935 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.562574 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.562575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.562708 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.562714 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.562803 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.562864 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":88,"threads_started":1}
I20260806 13:01:22.562963 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.558873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:44231 (local address 127.20.245.131:40529)
0806 13:01:22.558941 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.558944 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.559016 (+ 72us) server_negotiation.cc:407] Connection header received
0806 13:01:22.559135 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.559136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.559148 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.559266 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:22.559507 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.560334 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.562048 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.562476 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.562571 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.562583 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.562816 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.562866 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 13:01:22.563575 23059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f64bd26b4ef4b87aeabbb457ff2254f" candidate_uuid: "d1177621307546b0bae40bfcb1e839eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812f35ce4d74dcc93378f3f45ebec07" is_pre_election: true
I20260806 13:01:22.563839 23129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.558939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:53035 (local address 127.20.245.129:41741)
0806 13:01:22.558994 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.558996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.559104 (+ 108us) server_negotiation.cc:407] Connection header received
0806 13:01:22.559219 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.559220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.559232 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.559292 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:22.559487 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.560023 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.561758 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.562478 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.562565 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.562578 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.563688 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.563762 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 13:01:22.563827 23059 raft_consensus.cc:2454] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1177621307546b0bae40bfcb1e839eb in term 0.
I20260806 13:01:22.564067 23161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.558799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:41741 (local address 127.20.245.130:53035)
0806 13:01:22.559034 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.559044 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.559127 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.559339 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.559340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.559341 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:22.559404 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.559406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.560117 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.560118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.561629 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.561635 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.562727 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.562729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.563041 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.563047 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.563642 (+ 595us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.563705 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":68,"threads_started":1}
I20260806 13:01:22.564143 22850 leader_election.cc:302] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812f35ce4d74dcc93378f3f45ebec07, d1177621307546b0bae40bfcb1e839eb; no voters:
I20260806 13:01:22.564347 23139 raft_consensus.cc:2781] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:22.564394 23139 raft_consensus.cc:482] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:22.564417 23139 raft_consensus.cc:3037] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.564528 22772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f64bd26b4ef4b87aeabbb457ff2254f" candidate_uuid: "d1177621307546b0bae40bfcb1e839eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0778f954b354010916c53f063d4799c" is_pre_election: true
I20260806 13:01:22.564659 22772 raft_consensus.cc:2454] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1177621307546b0bae40bfcb1e839eb in term 0.
I20260806 13:01:22.566202 23139 raft_consensus.cc:504] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.566448 23139 leader_election.cc:288] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [CANDIDATE]: Term 1 election: Requested vote from peers e0778f954b354010916c53f063d4799c (127.20.245.129:41741), 0812f35ce4d74dcc93378f3f45ebec07 (127.20.245.131:40529)
I20260806 13:01:22.566807 23059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f64bd26b4ef4b87aeabbb457ff2254f" candidate_uuid: "d1177621307546b0bae40bfcb1e839eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812f35ce4d74dcc93378f3f45ebec07"
I20260806 13:01:22.566962 23059 raft_consensus.cc:3037] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.567447 22772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f64bd26b4ef4b87aeabbb457ff2254f" candidate_uuid: "d1177621307546b0bae40bfcb1e839eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0778f954b354010916c53f063d4799c"
I20260806 13:01:22.567550 22772 raft_consensus.cc:3037] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.568727 23059 raft_consensus.cc:2454] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1177621307546b0bae40bfcb1e839eb in term 1.
I20260806 13:01:22.568962 22772 raft_consensus.cc:2454] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1177621307546b0bae40bfcb1e839eb in term 1.
I20260806 13:01:22.569013 22850 leader_election.cc:302] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812f35ce4d74dcc93378f3f45ebec07, d1177621307546b0bae40bfcb1e839eb; no voters:
I20260806 13:01:22.569305 23139 raft_consensus.cc:2781] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:22.569536 23139 raft_consensus.cc:686] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 1 LEADER]: Becoming Leader. State: Replica: d1177621307546b0bae40bfcb1e839eb, State: Running, Role: LEADER
I20260806 13:01:22.569650 23139 consensus_queue.cc:237] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.570873 22610 catalog_manager.cc:5495] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb reported cstate change: term changed from 0 to 1, leader changed from <none> to d1177621307546b0bae40bfcb1e839eb (127.20.245.130). New cstate: current_term: 1 leader_uuid: "d1177621307546b0bae40bfcb1e839eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } health_report { overall_health: UNKNOWN } } }
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[22564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021281, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:22.618122 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.608627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37718 (local address 127.20.245.190:34903)
0806 13:01:22.608737 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.608740 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.608897 (+ 157us) server_negotiation.cc:407] Connection header received
0806 13:01:22.609006 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.609007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.609020 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.609137 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:22.609875 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.610474 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.611657 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.612041 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.612178 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.615023 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:22.615026 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:22.615026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:22.615036 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:22.616687 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.617149 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.617151 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.617152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.617239 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.617454 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.617455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.617456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.617595 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:22.617671 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.617864 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.617988 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 13:01:22.618194 23170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.608534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:34903 (local address 127.0.0.1:37718)
0806 13:01:22.608799 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.608810 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.608923 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.609146 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.609147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.609649 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:22.609737 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.609741 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.610840 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.610841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.611529 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.611532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.612179 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.612181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.612250 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.613053 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:22.613059 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:22.614907 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:22.616816 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:22.616827 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:22.616830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:22.617067 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:22.617323 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:22.617324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:22.617324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:22.617391 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:22.617668 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:22.617679 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:22.617743 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.617827 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.618051 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":91,"thread_start_us":150,"threads_started":1}
I20260806 13:01:22.621192 22610 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:37718:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 13:01:22.621554 22610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:22.623929 23039 tablet_service.cc:1467] Processing CreateTablet for tablet c1ff8991243842e88fb50cd6f936efc4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e5227e19f7634bd89989ed28a59e56a1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:22.624038 22895 tablet_service.cc:1467] Processing CreateTablet for tablet c1ff8991243842e88fb50cd6f936efc4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e5227e19f7634bd89989ed28a59e56a1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:22.624210 23039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ff8991243842e88fb50cd6f936efc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.624343 22895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ff8991243842e88fb50cd6f936efc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.623921 22752 tablet_service.cc:1467] Processing CreateTablet for tablet c1ff8991243842e88fb50cd6f936efc4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e5227e19f7634bd89989ed28a59e56a1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:22.626345 22752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1ff8991243842e88fb50cd6f936efc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:22.631299 23131 tablet_bootstrap.cc:492] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: Bootstrap starting.
I20260806 13:01:22.631645 23130 tablet_bootstrap.cc:492] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: Bootstrap starting.
I20260806 13:01:22.631914 23131 tablet_bootstrap.cc:654] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.632668 23130 tablet_bootstrap.cc:654] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.632716 23134 tablet_bootstrap.cc:492] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: Bootstrap starting.
I20260806 13:01:22.633353 23134 tablet_bootstrap.cc:654] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:22.633812 23130 tablet_bootstrap.cc:492] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: No bootstrap required, opened a new log
I20260806 13:01:22.633875 23130 ts_tablet_manager.cc:1397] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 13:01:22.633996 23131 tablet_bootstrap.cc:492] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: No bootstrap required, opened a new log
I20260806 13:01:22.634049 23131 ts_tablet_manager.cc:1397] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260806 13:01:22.634121 23130 raft_consensus.cc:348] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.634205 23130 raft_consensus.cc:374] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.634220 23130 raft_consensus.cc:729] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0778f954b354010916c53f063d4799c, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.634261 23130 consensus_queue.cc:260] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.634277 23131 raft_consensus.cc:348] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.634364 23131 raft_consensus.cc:374] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.634367 23130 ts_tablet_manager.cc:1428] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:22.634384 23131 raft_consensus.cc:729] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0812f35ce4d74dcc93378f3f45ebec07, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.634435 23131 consensus_queue.cc:260] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.634464 23135 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.634531 23131 ts_tablet_manager.cc:1428] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:22.634558 23135 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:22.634701 23152 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.634802 23152 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:22.635489 23134 tablet_bootstrap.cc:492] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: No bootstrap required, opened a new log
I20260806 13:01:22.635587 23134 ts_tablet_manager.cc:1397] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 13:01:22.635830 23134 raft_consensus.cc:348] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.635931 23134 raft_consensus.cc:374] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:22.635960 23134 raft_consensus.cc:729] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1177621307546b0bae40bfcb1e839eb, State: Initialized, Role: FOLLOWER
I20260806 13:01:22.636013 23134 consensus_queue.cc:260] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.636122 23134 ts_tablet_manager.cc:1428] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:22.636212 23139 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.636327 23139 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:22.656834 23152 raft_consensus.cc:482] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:22.657052 23152 raft_consensus.cc:504] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.657294 23152 leader_election.cc:288] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0778f954b354010916c53f063d4799c (127.20.245.129:41741), d1177621307546b0bae40bfcb1e839eb (127.20.245.130:40593)
I20260806 13:01:22.657657 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1ff8991243842e88fb50cd6f936efc4" candidate_uuid: "0812f35ce4d74dcc93378f3f45ebec07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1177621307546b0bae40bfcb1e839eb" is_pre_election: true
I20260806 13:01:22.657670 22772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1ff8991243842e88fb50cd6f936efc4" candidate_uuid: "0812f35ce4d74dcc93378f3f45ebec07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0778f954b354010916c53f063d4799c" is_pre_election: true
I20260806 13:01:22.657832 22916 raft_consensus.cc:2454] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0812f35ce4d74dcc93378f3f45ebec07 in term 0.
I20260806 13:01:22.657831 22772 raft_consensus.cc:2454] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0812f35ce4d74dcc93378f3f45ebec07 in term 0.
I20260806 13:01:22.658160 22992 leader_election.cc:302] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812f35ce4d74dcc93378f3f45ebec07, d1177621307546b0bae40bfcb1e839eb; no voters:
I20260806 13:01:22.658329 23152 raft_consensus.cc:2781] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:22.658392 23152 raft_consensus.cc:482] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:22.658413 23152 raft_consensus.cc:3037] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.660317 23152 raft_consensus.cc:504] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.660593 23152 leader_election.cc:288] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [CANDIDATE]: Term 1 election: Requested vote from peers e0778f954b354010916c53f063d4799c (127.20.245.129:41741), d1177621307546b0bae40bfcb1e839eb (127.20.245.130:40593)
I20260806 13:01:22.660933 22772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1ff8991243842e88fb50cd6f936efc4" candidate_uuid: "0812f35ce4d74dcc93378f3f45ebec07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0778f954b354010916c53f063d4799c"
I20260806 13:01:22.660921 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1ff8991243842e88fb50cd6f936efc4" candidate_uuid: "0812f35ce4d74dcc93378f3f45ebec07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1177621307546b0bae40bfcb1e839eb"
I20260806 13:01:22.661068 22916 raft_consensus.cc:3037] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.661068 22772 raft_consensus.cc:3037] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:22.661943 22772 raft_consensus.cc:2454] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0812f35ce4d74dcc93378f3f45ebec07 in term 1.
I20260806 13:01:22.662206 22916 raft_consensus.cc:2454] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0812f35ce4d74dcc93378f3f45ebec07 in term 1.
I20260806 13:01:22.662324 22990 leader_election.cc:302] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812f35ce4d74dcc93378f3f45ebec07, e0778f954b354010916c53f063d4799c; no voters:
I20260806 13:01:22.662453 23152 raft_consensus.cc:2781] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:22.662523 23152 raft_consensus.cc:686] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 LEADER]: Becoming Leader. State: Replica: 0812f35ce4d74dcc93378f3f45ebec07, State: Running, Role: LEADER
I20260806 13:01:22.662586 23152 consensus_queue.cc:237] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } }
I20260806 13:01:22.663323 23136 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: TxnStatusTablet state changed. Reason: New leader 0812f35ce4d74dcc93378f3f45ebec07. Latest consensus state: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.663447 23136 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:22.664398 23176 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 13:01:22.664554 23176 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 13:01:22.664453 22608 catalog_manager.cc:5495] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0812f35ce4d74dcc93378f3f45ebec07 (127.20.245.131). New cstate: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } health_report { overall_health: HEALTHY } } }
I20260806 13:01:22.679992 23170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.676194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:40529 (local address 127.0.0.1:48862)
0806 13:01:22.676370 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.676403 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.676460 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.676662 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.676663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.676664 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:22.676774 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.676778 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.677807 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.677807 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.678554 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.678557 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.679496 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.679497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.679558 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.679582 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:22.679794 (+ 212us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:22.679803 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.679841 (+ 38us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.679894 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260806 13:01:22.679992 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.676300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48862 (local address 127.20.245.131:40529)
0806 13:01:22.676418 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.676421 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.676496 (+ 75us) server_negotiation.cc:407] Connection header received
0806 13:01:22.676556 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.676557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.676570 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.676632 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:22.676859 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.677712 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.678672 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.679391 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.679478 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.679675 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:22.679722 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:22.679789 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.679862 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.679893 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 13:01:22.681597 22916 raft_consensus.cc:1261] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Refusing update from remote peer 0812f35ce4d74dcc93378f3f45ebec07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:22.681607 22772 raft_consensus.cc:1261] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Refusing update from remote peer 0812f35ce4d74dcc93378f3f45ebec07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:22.681977 23136 consensus_queue.cc:1035] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:22.682101 23152 consensus_queue.cc:1035] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:22.682951 23139 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: TxnStatusTablet state changed. Reason: New leader 0812f35ce4d74dcc93378f3f45ebec07. Latest consensus state: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.683074 23139 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:22.683912 23135 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: TxnStatusTablet state changed. Reason: New leader 0812f35ce4d74dcc93378f3f45ebec07. Latest consensus state: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.684046 23135 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:22.684120 23152 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.684239 23152 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:22.684484 23146 mvcc.cc:205] Tried to move back new op lower bound from 7315543173861441536 to 7315543173787213824. Current Snapshot: MvccSnapshot[applied={T|T < 7315543173861441536}]
I20260806 13:01:22.684623 23145 mvcc.cc:205] Tried to move back new op lower bound from 7315543173861441536 to 7315543173787213824. Current Snapshot: MvccSnapshot[applied={T|T < 7315543173861441536 or (T in {7315543173861441536})}]
I20260806 13:01:22.684939 23135 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.685055 23135 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P e0778f954b354010916c53f063d4799c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:22.686945 23136 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.687050 23136 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P 0812f35ce4d74dcc93378f3f45ebec07: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:22.687793 23139 tablet_replica.cc:439] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0812f35ce4d74dcc93378f3f45ebec07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 } } peers { permanent_uuid: "d1177621307546b0bae40bfcb1e839eb" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 40593 } } peers { permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 } } }
I20260806 13:01:22.687925 23139 tablet_replica.cc:442] T c1ff8991243842e88fb50cd6f936efc4 P d1177621307546b0bae40bfcb1e839eb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:22.692358 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.687940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52920 (local address 127.20.245.130:40593)
0806 13:01:22.688164 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.688167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.688181 (+ 14us) server_negotiation.cc:407] Connection header received
0806 13:01:22.688258 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.688260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.688302 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.688531 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:22.688842 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.690118 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.691278 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.691581 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.691703 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.691923 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:22.692080 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:22.692181 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.692207 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.692236 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186}
I20260806 13:01:22.700379 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.697085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:35405 (local address 127.20.245.131:40529)
0806 13:01:22.697167 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.697169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.697380 (+ 211us) server_negotiation.cc:407] Connection header received
0806 13:01:22.697444 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.697446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.697466 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.697537 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:22.697694 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.698412 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.699482 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.699817 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.699894 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.700067 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:22.700108 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:22.700157 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.700228 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.700256 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 13:01:22.700711 23182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.696978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:40529 (local address 127.20.245.130:35405)
0806 13:01:22.697286 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.697298 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.697367 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.697546 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.697547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.697548 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:22.697625 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.697627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.698504 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.698505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.699404 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.699407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.699896 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.699897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.699949 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.699969 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:22.700159 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:22.700161 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.700221 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.700264 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":136,"threads_started":1}
I20260806 13:01:22.704591 23059 raft_consensus.cc:1261] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Refusing update from remote peer d1177621307546b0bae40bfcb1e839eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:22.704939 22772 raft_consensus.cc:1261] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Refusing update from remote peer d1177621307546b0bae40bfcb1e839eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:22.705173 23163 consensus_queue.cc:1035] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0812f35ce4d74dcc93378f3f45ebec07" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:22.705461 23139 consensus_queue.cc:1035] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0778f954b354010916c53f063d4799c" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:22.717444 23186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.714040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:40593 (local address 127.20.245.131:41529)
0806 13:01:22.714348 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:22.714364 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:22.714454 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:22.714609 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:22.714610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:22.714612 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:22.714690 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.714693 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.715750 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.715751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.716525 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:22.716527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.716942 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.716943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:22.717007 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.717042 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:22.717247 (+ 205us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:22.717249 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 13:01:22.717291 (+ 42us) client_negotiation.cc:240] Negotiation successful
0806 13:01:22.717356 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":154,"threads_started":1}
I20260806 13:01:22.717440 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.714161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:41529 (local address 127.20.245.130:40593)
0806 13:01:22.714215 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.714218 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.714462 (+ 244us) server_negotiation.cc:407] Connection header received
0806 13:01:22.714533 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.714534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.714545 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.714602 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:22.714763 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.715597 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.716628 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.716861 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.716945 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.717143 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:22.717183 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:22.717237 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.717304 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.717333 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 13:01:22.732216 22608 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:22.732420 22608 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:22.733433 22608 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a64d963ccb048a3b59d1be23251408d: Sending DeleteTablet for 3 replicas of tablet 9f64bd26b4ef4b87aeabbb457ff2254f
I20260806 13:01:22.733881 22752 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f64bd26b4ef4b87aeabbb457ff2254f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:22 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:45330
I20260806 13:01:22.734112 23039 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f64bd26b4ef4b87aeabbb457ff2254f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:22 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:48842
I20260806 13:01:22.734160 23155 tablet_replica.cc:330] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: stopping tablet replica
I20260806 13:01:22.734246 23156 tablet_replica.cc:330] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: stopping tablet replica
I20260806 13:01:22.734246 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f64bd26b4ef4b87aeabbb457ff2254f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:22 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:52904
I20260806 13:01:22.734272 23155 raft_consensus.cc:2229] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:22.734319 23156 raft_consensus.cc:2229] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:22.734334 23155 raft_consensus.cc:2258] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:22.734344 23157 tablet_replica.cc:330] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: stopping tablet replica
I20260806 13:01:22.734365 23156 raft_consensus.cc:2258] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:22.734390 23157 raft_consensus.cc:2229] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:22.734506 23157 raft_consensus.cc:2258] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:22.734802 23155 ts_tablet_manager.cc:1905] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:22.735327 23157 ts_tablet_manager.cc:1905] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:22.737447 23157 ts_tablet_manager.cc:1918] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:22.737512 23157 log.cc:1196] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/9f64bd26b4ef4b87aeabbb457ff2254f
I20260806 13:01:22.737629 23155 ts_tablet_manager.cc:1918] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:22.737699 23155 log.cc:1196] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/9f64bd26b4ef4b87aeabbb457ff2254f
I20260806 13:01:22.737808 23157 ts_tablet_manager.cc:1939] T 9f64bd26b4ef4b87aeabbb457ff2254f P d1177621307546b0bae40bfcb1e839eb: Deleting consensus metadata
I20260806 13:01:22.737986 23155 ts_tablet_manager.cc:1939] T 9f64bd26b4ef4b87aeabbb457ff2254f P e0778f954b354010916c53f063d4799c: Deleting consensus metadata
I20260806 13:01:22.738245 23156 ts_tablet_manager.cc:1905] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:22.738449 22596 catalog_manager.cc:4841] TS d1177621307546b0bae40bfcb1e839eb (127.20.245.130:40593): tablet 9f64bd26b4ef4b87aeabbb457ff2254f (table test-table [id=8cabfec0d2554d558675bac6a2fdb399]) successfully deleted
I20260806 13:01:22.738579 22593 catalog_manager.cc:4841] TS e0778f954b354010916c53f063d4799c (127.20.245.129:41741): tablet 9f64bd26b4ef4b87aeabbb457ff2254f (table test-table [id=8cabfec0d2554d558675bac6a2fdb399]) successfully deleted
I20260806 13:01:22.740200 23156 ts_tablet_manager.cc:1918] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:22.740278 23156 log.cc:1196] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/9f64bd26b4ef4b87aeabbb457ff2254f
I20260806 13:01:22.740520 23156 ts_tablet_manager.cc:1939] T 9f64bd26b4ef4b87aeabbb457ff2254f P 0812f35ce4d74dcc93378f3f45ebec07: Deleting consensus metadata
I20260806 13:01:22.742012 22597 catalog_manager.cc:4841] TS 0812f35ce4d74dcc93378f3f45ebec07 (127.20.245.131:40529): tablet 9f64bd26b4ef4b87aeabbb457ff2254f (table test-table [id=8cabfec0d2554d558675bac6a2fdb399]) successfully deleted
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[22564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021282, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:22.755630 23129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.741927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45342 (local address 127.20.245.129:41741)
0806 13:01:22.742169 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.742172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.743429 (+ 1257us) server_negotiation.cc:407] Connection header received
0806 13:01:22.743554 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.743555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.743578 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.743655 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:22.744500 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.745414 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.746597 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.746950 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.747039 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.751314 (+ 4275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:22.751339 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:22.751340 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:22.751352 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:22.753987 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.754518 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.754524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.754524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.754609 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.754847 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.754848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.754849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.755105 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:22.755331 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.755401 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.755501 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211}
W20260806 13:01:22.756454 22814 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45342
I20260806 13:01:22.766566 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:22.757788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37730 (local address 127.20.245.190:34903)
0806 13:01:22.757850 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:22.757853 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:22.758128 (+ 275us) server_negotiation.cc:407] Connection header received
0806 13:01:22.758191 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:22.758192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:22.758209 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:22.758276 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:22.759009 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.760055 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.761165 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:22.761555 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:22.761638 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:22.763425 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:22.763427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:22.763427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:22.763438 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:22.765233 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.765654 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.765655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.765656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.765713 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:22.765907 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:22.765908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:22.765909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:22.766053 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:22.766135 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:22.766343 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 13:01:22.766433 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260806 13:01:22.767467 22608 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37730
I20260806 13:01:22.768606 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 22685
I20260806 13:01:22.780207 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 22830
I20260806 13:01:22.788180 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 22973
I20260806 13:01:22.796494 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 22577
2026-08-06T13:01:22Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2890 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[23195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[23195](info): set up 2 sockets
Aug 06 13:01:22 dist-test-slave-srgv krb5kdc[23195](info): commencing operation
krb5kdc: starting...
W20260806 13:01:23.907015 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:24.056066 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:38067
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:38067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:24.155025 23208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:24.155325 23208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:24.155352 23208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:24.156587 23208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:24.156629 23208 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 13:01:24.156642 23208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:24.156656 23208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:24.156668 23208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:24.156682 23208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:24.158203 23208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:38067
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:38067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:24.158448 23208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:24.158668 23208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:24.164934 23216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:24.164973 23214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:24.164934 23213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:24.165001 23208 server_base.cc:1034] running on GCE node
I20260806 13:01:24.165529 23208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:24.165926 23208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:24.167228 23208 hybrid_clock.cc:648] HybridClock initialized: now 1786021284167165 us; error 63 us; skew 500 ppm
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:24.170533 23208 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:24.171114 23208 webserver.cc:460] Webserver started at http://127.20.245.190:34705/ using document root <none> and password file <none>
I20260806 13:01:24.171454 23208 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:24.171541 23208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:24.171800 23208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:24.173293 23208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "fff9b52ff43745ba865347a15c637ae2"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "1ab0efeb3d07cd95dc8228fe574a2e0f"
server_key_iv: "78197c51cfd0ae08dacca64583ec49f2"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.173764 23208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "fff9b52ff43745ba865347a15c637ae2"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "1ab0efeb3d07cd95dc8228fe574a2e0f"
server_key_iv: "78197c51cfd0ae08dacca64583ec49f2"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.175581 23208 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 13:01:24.176728 23224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:24.176964 23208 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:24.177086 23208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "fff9b52ff43745ba865347a15c637ae2"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "1ab0efeb3d07cd95dc8228fe574a2e0f"
server_key_iv: "78197c51cfd0ae08dacca64583ec49f2"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.177222 23208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:24.201776 23208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:24.204631 23208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:24.204844 23208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:24.211305 23208 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:38067
I20260806 13:01:24.211366 23288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:38067 every 8 connection(s)
I20260806 13:01:24.211790 23208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:24.212587 23289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:24.213991 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 23208
I20260806 13:01:24.214107 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:24.214315 21462 external_mini_cluster.cc:1428] Setting key 309ac5c1172de7bff6a802d47d600425
I20260806 13:01:24.216049 23289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: Bootstrap starting.
I20260806 13:01:24.216817 23289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:24.217159 23289 log.cc:824] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:24.218118 23289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: No bootstrap required, opened a new log
I20260806 13:01:24.220791 23289 raft_consensus.cc:348] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9b52ff43745ba865347a15c637ae2" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38067 } }
I20260806 13:01:24.221015 23289 raft_consensus.cc:374] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:24.221076 23289 raft_consensus.cc:729] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff9b52ff43745ba865347a15c637ae2, State: Initialized, Role: FOLLOWER
I20260806 13:01:24.221292 23289 consensus_queue.cc:260] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9b52ff43745ba865347a15c637ae2" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38067 } }
I20260806 13:01:24.221410 23289 raft_consensus.cc:388] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:24.221463 23289 raft_consensus.cc:482] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:24.221518 23289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 0 FOLLOWER]: Advancing to term 1
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:24.222574 23289 raft_consensus.cc:504] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9b52ff43745ba865347a15c637ae2" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38067 } }
I20260806 13:01:24.222736 23289 leader_election.cc:302] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fff9b52ff43745ba865347a15c637ae2; no voters:
I20260806 13:01:24.223018 23289 leader_election.cc:288] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:24.223098 23294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:24.223462 23289 sys_catalog.cc:564] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:24.223376 23294 raft_consensus.cc:686] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [term 1 LEADER]: Becoming Leader. State: Replica: fff9b52ff43745ba865347a15c637ae2, State: Running, Role: LEADER
I20260806 13:01:24.223800 23294 consensus_queue.cc:237] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9b52ff43745ba865347a15c637ae2" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38067 } }
I20260806 13:01:24.224278 23296 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fff9b52ff43745ba865347a15c637ae2. Latest consensus state: current_term: 1 leader_uuid: "fff9b52ff43745ba865347a15c637ae2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9b52ff43745ba865347a15c637ae2" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38067 } } }
I20260806 13:01:24.224786 23296 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:24.224819 23295 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fff9b52ff43745ba865347a15c637ae2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9b52ff43745ba865347a15c637ae2" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38067 } } }
I20260806 13:01:24.225502 23295 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2 [sys.catalog]: This master's current role is: LEADER
W20260806 13:01:24.225803 23310 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:01:24.225867 23310 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:01:24.225977 23309 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:24.226254 23309 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:24.228199 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.215002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59000 (local address 127.20.245.190:38067)
0806 13:01:24.215286 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.215297 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.215328 (+ 31us) server_negotiation.cc:407] Connection header received
0806 13:01:24.215825 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.215833 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.215893 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.216074 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:24.216807 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.218069 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.218951 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.219502 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.219633 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.223337 (+ 3704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:24.223344 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:24.223344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:24.223361 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:24.225988 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.226594 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.226599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.226599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.226731 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.226985 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.226987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.226987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.227386 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:24.227563 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.227752 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.227959 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":106,"threads_started":1}
I20260806 13:01:24.228744 23309 catalog_manager.cc:1347] Generated new cluster ID: 08e26a202b8e4a45985e870001f58a38
I20260806 13:01:24.228792 23309 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:24.247890 23309 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:24.248564 23309 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:24.254567 23309 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: Generated new TSK 0
I20260806 13:01:24.254917 23309 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:24.298974 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38067
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:24.403251 23315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:24.403558 23315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:24.403590 23315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:24.405036 23315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:24.405097 23315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:24.405121 23315 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 13:01:24.405133 23315 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:24.405187 23315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:24.407863 23315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:38067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:24.408293 23315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:24.408660 23315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:24.416827 23321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:24.416868 23320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:24.416857 23323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:24.418545 23315 server_base.cc:1034] running on GCE node
I20260806 13:01:24.418845 23315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:24.419162 23315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:24.420393 23315 hybrid_clock.cc:648] HybridClock initialized: now 1786021284420386 us; error 41 us; skew 500 ppm
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:24.423704 23315 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:24.424214 23315 webserver.cc:460] Webserver started at http://127.20.245.129:32997/ using document root <none> and password file <none>
I20260806 13:01:24.424508 23315 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:24.424558 23315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:24.424731 23315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:24.426072 23315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "55cd93ba4f1e412d9983e4106dacd399"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "cdf79b7d4654602c961e28b4706dd50d"
server_key_iv: "4c09a653d013830e2a359dff94e7148e"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.426498 23315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "55cd93ba4f1e412d9983e4106dacd399"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "cdf79b7d4654602c961e28b4706dd50d"
server_key_iv: "4c09a653d013830e2a359dff94e7148e"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.428249 23315 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 13:01:24.429255 23331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:24.429481 23315 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:24.429585 23315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "55cd93ba4f1e412d9983e4106dacd399"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "cdf79b7d4654602c961e28b4706dd50d"
server_key_iv: "4c09a653d013830e2a359dff94e7148e"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.429672 23315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:24.457064 23315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:24.460136 23315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:24.460382 23315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:24.461071 23315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:24.461110 23315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:24.461143 23315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:24.461158 23315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:24.470146 23315 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:40485
I20260806 13:01:24.470242 23451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:40485 every 8 connection(s)
I20260806 13:01:24.470678 23315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:24.473845 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.461807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:34839 (local address 127.20.245.190:38067)
0806 13:01:24.461895 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.461897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.462157 (+ 260us) server_negotiation.cc:407] Connection header received
0806 13:01:24.462885 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.462887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.462907 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.462993 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:24.463997 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.464998 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.466169 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.466576 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.466666 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.470366 (+ 3700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:24.470369 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:24.470370 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:24.470380 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:24.472199 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.472657 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.472659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.472659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.472734 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.473068 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.473069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.473069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.473225 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:24.473295 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.473620 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.473732 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 13:01:24.474032 23340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.461769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38067 (local address 127.20.245.129:34839)
0806 13:01:24.461974 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.462028 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.462734 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.463125 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.463132 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.463494 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:24.463868 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.463877 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.465136 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.465137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.466064 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.466067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.466714 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.466715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.466885 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.467648 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:24.467663 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:24.470234 (+ 2571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:24.472302 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.472311 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.472313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.472572 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.472849 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.472851 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.472851 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.472991 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.473308 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:24.473316 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:24.473483 (+ 167us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.473584 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.473752 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":120,"threads_started":1}
I20260806 13:01:24.474725 23452 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38067
I20260806 13:01:24.474834 23452 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:24.475055 23452 heartbeater.cc:511] Master 127.20.245.190:38067 requested a full tablet report, sending...
I20260806 13:01:24.475768 23240 ts_manager.cc:194] Registered new tserver with Master: 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485)
I20260806 13:01:24.476550 23240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:34839
I20260806 13:01:24.478289 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 23315
I20260806 13:01:24.478410 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:24.478678 21462 external_mini_cluster.cc:1428] Setting key e7ddb1576c7e4a06bc34029e5a47ff27
I20260806 13:01:24.483258 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.475986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38067 (local address 127.20.245.129:55605)
0806 13:01:24.476149 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.476159 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.476235 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.476371 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.476372 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.476573 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:24.476643 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.476645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.477375 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.477377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.477949 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.477952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.478294 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.478296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.478397 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.479012 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:24.479018 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:24.479548 (+ 530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:24.482135 (+ 2587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.482136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.482137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.482354 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.482579 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.482580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.482580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.482625 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.482887 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:24.482887 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:24.482943 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.482991 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.483093 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260806 13:01:24.483280 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.476075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:55605 (local address 127.20.245.190:38067)
0806 13:01:24.476130 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.476133 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.476231 (+ 98us) server_negotiation.cc:407] Connection header received
0806 13:01:24.476297 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.476298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.476309 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.476366 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:24.476734 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.477276 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.478031 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.478220 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.478305 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.479639 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:24.479641 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:24.479641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:24.479649 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:24.481992 (+ 2343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.482434 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.482436 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.482436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.482510 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.482660 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.482661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.482662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.482828 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:24.482904 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.483047 (+ 143us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.483146 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:24.511246 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38067
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:24.616029 23461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:24.616420 23461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:24.616484 23461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:24.617842 23461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:24.617888 23461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:24.617910 23461 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 13:01:24.617923 23461 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:24.617940 23461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:24.619714 23461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:38067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:24.619977 23461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:24.620246 23461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:24.626410 23466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:24.626441 23470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:24.626408 23468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:24.626852 23461 server_base.cc:1034] running on GCE node
I20260806 13:01:24.627099 23461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:24.627451 23461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:24.628618 23461 hybrid_clock.cc:648] HybridClock initialized: now 1786021284628604 us; error 39 us; skew 500 ppm
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:24.631873 23461 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:24.632510 23461 webserver.cc:460] Webserver started at http://127.20.245.130:33787/ using document root <none> and password file <none>
I20260806 13:01:24.632800 23461 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:24.632850 23461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:24.633036 23461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:24.634577 23461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "9ce90b417be446ae83118bce93c4fce8"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "455826f50de117c0591630a64a12997e"
server_key_iv: "9aa51f02db771feaf2f47892d41e4385"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.635021 23461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "9ce90b417be446ae83118bce93c4fce8"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "455826f50de117c0591630a64a12997e"
server_key_iv: "9aa51f02db771feaf2f47892d41e4385"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.636776 23461 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260806 13:01:24.637742 23478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:24.637943 23461 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:24.638049 23461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "9ce90b417be446ae83118bce93c4fce8"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "455826f50de117c0591630a64a12997e"
server_key_iv: "9aa51f02db771feaf2f47892d41e4385"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.638113 23461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:24.672695 23461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:24.675659 23461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:24.675864 23461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:24.676537 23461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:24.676618 23461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:24.676653 23461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:24.676681 23461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:24.685317 23461 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:43571
I20260806 13:01:24.685393 23597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:43571 every 8 connection(s)
I20260806 13:01:24.685789 23461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:24.689567 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 23461
I20260806 13:01:24.689702 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:24.689924 21462 external_mini_cluster.cc:1428] Setting key 6f720cdf27cb3dea733c1a8c6038b354
I20260806 13:01:24.690608 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.677431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:55517 (local address 127.20.245.190:38067)
0806 13:01:24.677516 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.677520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.677849 (+ 329us) server_negotiation.cc:407] Connection header received
0806 13:01:24.678738 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.678741 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.678759 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.678856 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:24.680051 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.681069 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.682960 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.683374 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.683467 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.686878 (+ 3411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:24.686880 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:24.686880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:24.686890 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:24.688655 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.689174 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.689176 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.689177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.689251 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.689569 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.689570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.689571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.689785 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:24.689856 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.690421 (+ 565us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.690527 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 13:01:24.690874 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.677418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38067 (local address 127.20.245.130:55517)
0806 13:01:24.677670 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.677729 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.678572 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.678967 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.678975 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.679507 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:24.679910 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.679920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.681226 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.681227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.682841 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.682845 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.683487 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.683488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.683908 (+ 420us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.684660 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:24.684676 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:24.686742 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:24.688778 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.688787 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.688790 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.689067 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.689339 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.689340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.689340 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.689483 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.689855 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:24.689865 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:24.690112 (+ 247us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.690280 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.690538 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":170,"threads_started":1}
I20260806 13:01:24.691483 23598 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38067
I20260806 13:01:24.691602 23598 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:24.691884 23598 heartbeater.cc:511] Master 127.20.245.190:38067 requested a full tablet report, sending...
I20260806 13:01:24.692332 23240 ts_manager.cc:194] Registered new tserver with Master: 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571)
I20260806 13:01:24.692935 23240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:55517
I20260806 13:01:24.699823 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.692998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:49405 (local address 127.20.245.190:38067)
0806 13:01:24.693158 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.693160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.693172 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:24.693199 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.693200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.693214 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.693287 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:24.693713 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.694279 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.695075 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.695393 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.695485 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.696691 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:24.696693 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:24.696693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:24.696701 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:24.698351 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.698771 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.698773 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.698773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.698841 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.699069 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.699070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.699070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.699333 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:24.699421 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.699604 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.699712 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260806 13:01:24.699837 23604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.692719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38067 (local address 127.20.245.130:49405)
0806 13:01:24.692977 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.692992 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.693063 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.693305 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.693307 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.693530 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:24.693612 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.693614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.694384 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.694385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.694971 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.694972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.695486 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.695487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.695595 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.696200 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:24.696205 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:24.696561 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:24.698462 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.698463 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.698463 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.698675 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.698923 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.698924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.698925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.698999 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.699410 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:24.699411 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:24.699471 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.699569 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.699705 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":179,"threads_started":1}
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:24.722546 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38067
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:24.821843 23607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:24.822194 23607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:24.822230 23607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:24.823963 23607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:24.824038 23607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:24.824064 23607 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 13:01:24.824077 23607 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:24.824134 23607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:24.826241 23607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:38067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:24.826638 23607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:24.826965 23607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:24.833701 23615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:24.833678 23613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:24.833709 23612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:24.834208 23607 server_base.cc:1034] running on GCE node
I20260806 13:01:24.834517 23607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:24.834892 23607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:24.836072 23607 hybrid_clock.cc:648] HybridClock initialized: now 1786021284836042 us; error 51 us; skew 500 ppm
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:24.839349 23607 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:24.839917 23607 webserver.cc:460] Webserver started at http://127.20.245.131:42047/ using document root <none> and password file <none>
I20260806 13:01:24.840224 23607 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:24.840301 23607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:24.840472 23607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:24.841828 23607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "9f18f34c804044469ce1bf6f266f0c19"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "585dd2d8775929df420ead4f56457022"
server_key_iv: "7b15b46fba7d902490e6c4f017290bc4"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.842290 23607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "9f18f34c804044469ce1bf6f266f0c19"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "585dd2d8775929df420ead4f56457022"
server_key_iv: "7b15b46fba7d902490e6c4f017290bc4"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.844034 23607 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 13:01:24.844901 23622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:24.845086 23607 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:24.845238 23607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "9f18f34c804044469ce1bf6f266f0c19"
format_stamp: "Formatted at 2026-08-06 13:01:24 on dist-test-slave-srgv"
server_key: "585dd2d8775929df420ead4f56457022"
server_key_iv: "7b15b46fba7d902490e6c4f017290bc4"
server_key_version: "encryptionkey@0"
I20260806 13:01:24.845327 23607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:24.856175 23607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:24.858975 23607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:24.859227 23607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:24.859896 23607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:24.859956 23607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:24.859995 23607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:24.860023 23607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:24.869089 23607 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:38171
I20260806 13:01:24.869199 23742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:38171 every 8 connection(s)
I20260806 13:01:24.869642 23607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:24.869876 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 23607
I20260806 13:01:24.869977 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:24.870223 21462 external_mini_cluster.cc:1428] Setting key 7277f8f25d7303f5682487657c6f5a08
I20260806 13:01:24.872378 23632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.860459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38067 (local address 127.20.245.131:34735)
0806 13:01:24.860655 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.860701 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.861286 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.861616 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.861622 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.862020 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:24.862378 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.862387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.863626 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.863627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.864585 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.864588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.865149 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.865151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.865322 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.865987 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:24.866011 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:24.868261 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:24.870308 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.870315 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.870318 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.870640 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.870863 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.870864 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.870865 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.871036 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.871488 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:24.871494 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:24.871705 (+ 211us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.871868 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.872092 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":108,"threads_started":1}
I20260806 13:01:24.872954 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.860514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:34735 (local address 127.20.245.190:38067)
0806 13:01:24.860607 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.860610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.860822 (+ 212us) server_negotiation.cc:407] Connection header received
0806 13:01:24.861401 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.861402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.861421 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.861510 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:24.862504 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.863482 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.864674 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.865037 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.865132 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.868395 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:24.868397 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:24.868397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:24.868407 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:24.870137 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.870711 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.870712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.870713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.870792 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.871134 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.871135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.871136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.871370 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:24.871449 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.872719 (+ 1270us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.872841 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 13:01:24.873279 23743 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38067
I20260806 13:01:24.873364 23743 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:24.873589 23743 heartbeater.cc:511] Master 127.20.245.190:38067 requested a full tablet report, sending...
I20260806 13:01:24.874621 23240 ts_manager.cc:194] Registered new tserver with Master: 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171)
I20260806 13:01:24.875276 23240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:34735
I20260806 13:01:24.882802 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.874653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:50315 (local address 127.20.245.190:38067)
0806 13:01:24.874733 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.874735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.875007 (+ 272us) server_negotiation.cc:407] Connection header received
0806 13:01:24.875052 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.875054 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.875069 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.875154 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:24.875860 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.876763 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.877880 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.878091 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.878150 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.879561 (+ 1411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:24.879563 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:24.879563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:24.879570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:24.881472 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.881928 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.881929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.881930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.881999 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.882221 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.882222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.882222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.882352 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:24.882430 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.882604 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.882691 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 13:01:24.882825 23749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.874739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38067 (local address 127.20.245.131:50315)
0806 13:01:24.874910 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.874922 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.874994 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.875195 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.875196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.875564 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:24.875660 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.875663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.876904 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.876905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.877769 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.877773 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.878168 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.878169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.878254 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.878977 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:24.878984 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:24.879479 (+ 495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:24.881578 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.881579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.881579 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.881832 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.882069 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:24.882070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:24.882070 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:24.882144 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:24.882421 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:24.882423 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:24.882475 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.882558 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.882713 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
I20260806 13:01:24.884022 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 13:01:24 dist-test-slave-srgv krb5kdc[23195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:24.911075 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.902546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59002 (local address 127.20.245.190:38067)
0806 13:01:24.902626 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.902629 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.902642 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:01:24.902699 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.902700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.902711 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.902757 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:24.903543 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.904193 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.905000 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.905245 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.905317 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.908005 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:24.908007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:24.908007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:24.908018 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:24.909684 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.910085 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.910086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.910087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.910200 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:24.910396 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:24.910397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:24.910398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:24.910570 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:24.910672 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.910817 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.910906 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 13:01:24.913825 23240 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:24.916194 23240 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:24.924897 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.919936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:38171 (local address 127.0.0.1:34666)
0806 13:01:24.920646 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.920657 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.920723 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.920959 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.920959 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.920962 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:24.920996 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.920997 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.921896 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.921897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.923455 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.923459 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.924451 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.924452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.924541 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.924565 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.924674 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.924756 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"mutex_wait_us":93,"thread_start_us":108,"threads_started":1}
I20260806 13:01:24.924904 23765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.920242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34666 (local address 127.20.245.131:38171)
0806 13:01:24.920482 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.920487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.920786 (+ 299us) server_negotiation.cc:407] Connection header received
0806 13:01:24.920842 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.920844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.920862 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.921000 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:24.921079 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.921802 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.923573 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.924320 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.924431 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.924506 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.924712 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.924761 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":100,"threads_started":1}
I20260806 13:01:24.925068 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.919934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56468 (local address 127.20.245.129:40485)
0806 13:01:24.920353 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.920360 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.920372 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:24.920421 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.920424 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.920442 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.920530 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:24.920749 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.922025 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.923553 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.924370 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.924461 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.924849 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.924882 (+ 33us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.924930 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":125,"threads_started":1}
I20260806 13:01:24.925482 23760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.919672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40485 (local address 127.0.0.1:56468)
0806 13:01:24.919836 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.919887 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.919969 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.920533 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.920537 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.920540 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:24.920647 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.920650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.922160 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.922161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.923478 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.923480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.924542 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.924543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.924635 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.924639 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.924712 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.924762 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":4,"thread_start_us":89,"threads_started":1}
I20260806 13:01:24.925837 23761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.919687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:43571 (local address 127.0.0.1:38424)
0806 13:01:24.919851 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:24.919887 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:24.919969 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:24.920783 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:24.920784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:24.920786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:24.920835 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.920837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.922131 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.922132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.923379 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:24.923382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.925588 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.925589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:24.925655 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.925659 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:24.925727 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 13:01:24.925774 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":38,"thread_start_us":115,"threads_started":1}
I20260806 13:01:24.925869 23674 tablet_service.cc:1467] Processing CreateTablet for tablet 4d0d06efbd5c4889a31c6b8019252703 (DEFAULT_TABLE table=test-table [id=650c1a783f424ac4b58935439df8cdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:24.926137 23766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:24.920240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38424 (local address 127.20.245.130:43571)
0806 13:01:24.920580 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:24.920585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:24.920596 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:24.920650 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:24.920652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:24.920668 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:24.920790 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:24.920900 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.922025 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.923499 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:24.924378 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:24.924455 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:24.924511 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:24.925969 (+ 1458us) server_negotiation.cc:299] Negotiation successful
0806 13:01:24.926023 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":105,"threads_started":1}
I20260806 13:01:24.926384 23674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d0d06efbd5c4889a31c6b8019252703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:24.926323 23382 tablet_service.cc:1467] Processing CreateTablet for tablet 4d0d06efbd5c4889a31c6b8019252703 (DEFAULT_TABLE table=test-table [id=650c1a783f424ac4b58935439df8cdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:24.926700 23382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d0d06efbd5c4889a31c6b8019252703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:24.926913 23529 tablet_service.cc:1467] Processing CreateTablet for tablet 4d0d06efbd5c4889a31c6b8019252703 (DEFAULT_TABLE table=test-table [id=650c1a783f424ac4b58935439df8cdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:24.927331 23529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d0d06efbd5c4889a31c6b8019252703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:24.930030 23767 tablet_bootstrap.cc:492] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Bootstrap starting.
I20260806 13:01:24.930837 23767 tablet_bootstrap.cc:654] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:24.931079 23768 tablet_bootstrap.cc:492] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Bootstrap starting.
I20260806 13:01:24.931329 23767 log.cc:824] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:24.931695 23769 tablet_bootstrap.cc:492] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Bootstrap starting.
I20260806 13:01:24.932310 23767 tablet_bootstrap.cc:492] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: No bootstrap required, opened a new log
I20260806 13:01:24.932390 23767 ts_tablet_manager.cc:1397] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:24.932437 23768 tablet_bootstrap.cc:654] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:24.932472 23769 tablet_bootstrap.cc:654] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:24.932705 23768 log.cc:824] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:24.932868 23769 log.cc:824] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:24.933624 23768 tablet_bootstrap.cc:492] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: No bootstrap required, opened a new log
I20260806 13:01:24.933662 23769 tablet_bootstrap.cc:492] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: No bootstrap required, opened a new log
I20260806 13:01:24.933686 23768 ts_tablet_manager.cc:1397] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:01:24.933708 23769 ts_tablet_manager.cc:1397] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:24.934859 23767 raft_consensus.cc:348] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:24.935048 23767 raft_consensus.cc:374] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:24.935087 23767 raft_consensus.cc:729] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55cd93ba4f1e412d9983e4106dacd399, State: Initialized, Role: FOLLOWER
I20260806 13:01:24.935266 23767 consensus_queue.cc:260] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:24.935586 23767 ts_tablet_manager.cc:1428] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 13:01:24.935714 23769 raft_consensus.cc:348] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:24.935915 23769 raft_consensus.cc:374] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:24.935961 23769 raft_consensus.cc:729] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce90b417be446ae83118bce93c4fce8, State: Initialized, Role: FOLLOWER
I20260806 13:01:24.935947 23768 raft_consensus.cc:348] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:24.936108 23768 raft_consensus.cc:374] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:24.936096 23769 consensus_queue.cc:260] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:24.936167 23768 raft_consensus.cc:729] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f18f34c804044469ce1bf6f266f0c19, State: Initialized, Role: FOLLOWER
I20260806 13:01:24.936308 23768 consensus_queue.cc:260] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:24.936409 23769 ts_tablet_manager.cc:1428] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:01:24.936457 23598 heartbeater.cc:503] Master 127.20.245.190:38067 was elected leader, sending a full tablet report...
I20260806 13:01:24.936589 23768 ts_tablet_manager.cc:1428] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:01:24.936735 23743 heartbeater.cc:503] Master 127.20.245.190:38067 was elected leader, sending a full tablet report...
I20260806 13:01:24.936772 23452 heartbeater.cc:503] Master 127.20.245.190:38067 was elected leader, sending a full tablet report...
W20260806 13:01:24.971772 23453 tablet.cc:2369] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:25.102075 23774 raft_consensus.cc:482] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:25.102314 23774 raft_consensus.cc:504] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:25.102880 23774 leader_election.cc:288] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171), 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571)
I20260806 13:01:25.106817 23778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.103165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:43571 (local address 127.20.245.129:47093)
0806 13:01:25.103488 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:25.103499 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:25.103605 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:25.103772 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:25.103777 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:25.103779 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:25.103847 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.103849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.104629 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.104630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.105486 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.105489 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.106432 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.106434 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.106519 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.106525 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:01:25.106618 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 13:01:25.106680 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":121,"threads_started":1}
I20260806 13:01:25.106807 23766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.103400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:47093 (local address 127.20.245.130:43571)
0806 13:01:25.103502 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:25.103505 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:25.103608 (+ 103us) server_negotiation.cc:407] Connection header received
0806 13:01:25.103680 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:25.103681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:25.103692 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:25.103765 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:25.103943 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.104514 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.105620 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.106331 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.106432 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.106449 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:25.106628 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 13:01:25.106692 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 13:01:25.106997 23765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.103400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:48247 (local address 127.20.245.131:38171)
0806 13:01:25.103470 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:25.103473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:25.103487 (+ 14us) server_negotiation.cc:407] Connection header received
0806 13:01:25.103590 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:25.103591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:25.103603 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:25.103664 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:25.103921 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.104488 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.105885 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.106594 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.106661 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.106671 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:25.106871 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 13:01:25.106921 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:01:25.107299 23777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.103158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:38171 (local address 127.20.245.129:48247)
0806 13:01:25.103382 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:25.103398 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:25.103491 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:25.103692 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:25.103693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:25.103696 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:25.103830 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.103834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.104601 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.104603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.105750 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.105754 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.106707 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.106707 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.106785 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.106789 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:25.107106 (+ 317us) client_negotiation.cc:240] Negotiation successful
0806 13:01:25.107205 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":132,"thread_start_us":131,"threads_started":1}
I20260806 13:01:25.107470 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0d06efbd5c4889a31c6b8019252703" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8" is_pre_election: true
I20260806 13:01:25.107684 23550 raft_consensus.cc:2454] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 0.
I20260806 13:01:25.107997 23334 leader_election.cc:302] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55cd93ba4f1e412d9983e4106dacd399, 9ce90b417be446ae83118bce93c4fce8; no voters:
I20260806 13:01:25.108049 23695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0d06efbd5c4889a31c6b8019252703" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f18f34c804044469ce1bf6f266f0c19" is_pre_election: true
I20260806 13:01:25.108235 23695 raft_consensus.cc:2454] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 0.
I20260806 13:01:25.108378 23774 raft_consensus.cc:2781] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:25.108480 23774 raft_consensus.cc:482] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:25.108531 23774 raft_consensus.cc:3037] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.109540 23774 raft_consensus.cc:504] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:25.109762 23774 leader_election.cc:288] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 election: Requested vote from peers 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171), 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571)
I20260806 13:01:25.110015 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0d06efbd5c4889a31c6b8019252703" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8"
I20260806 13:01:25.110024 23695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0d06efbd5c4889a31c6b8019252703" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f18f34c804044469ce1bf6f266f0c19"
I20260806 13:01:25.110140 23695 raft_consensus.cc:3037] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.110157 23550 raft_consensus.cc:3037] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.111066 23695 raft_consensus.cc:2454] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 1.
I20260806 13:01:25.111071 23550 raft_consensus.cc:2454] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 1.
I20260806 13:01:25.111330 23332 leader_election.cc:302] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55cd93ba4f1e412d9983e4106dacd399, 9f18f34c804044469ce1bf6f266f0c19; no voters:
I20260806 13:01:25.111490 23774 raft_consensus.cc:2781] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:25.111665 23774 raft_consensus.cc:686] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 LEADER]: Becoming Leader. State: Replica: 55cd93ba4f1e412d9983e4106dacd399, State: Running, Role: LEADER
I20260806 13:01:25.111805 23774 consensus_queue.cc:237] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } }
I20260806 13:01:25.113365 23241 catalog_manager.cc:5495] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } health_report { overall_health: UNKNOWN } } }
W20260806 13:01:25.120625 23744 tablet.cc:2369] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 13:01:25 dist-test-slave-srgv krb5kdc[23195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:25.184691 23786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.176415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38067 (local address 127.0.0.1:59012)
0806 13:01:25.176684 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:25.176697 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:25.176790 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:25.176951 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:25.176951 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:25.177363 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:25.177436 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.177439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.178299 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.178300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.178856 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.178857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.179329 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.179330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.179378 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.180136 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:25.180140 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:25.181853 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:25.183520 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:25.183529 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:25.183532 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:25.183741 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:25.183952 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:25.183953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:25.183953 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:25.184009 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:25.184331 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:25.184340 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:25.184388 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 13:01:25.184443 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 13:01:25.184551 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":161,"threads_started":1}
I20260806 13:01:25.184693 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.176493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59012 (local address 127.20.245.190:38067)
0806 13:01:25.176607 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:25.176610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:25.176784 (+ 174us) server_negotiation.cc:407] Connection header received
0806 13:01:25.176862 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:25.176863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:25.176876 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:25.176926 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:25.177577 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.178189 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.178932 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.179157 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.179288 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.181937 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:25.181938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:25.181939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:25.181945 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:25.183448 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:25.183831 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:25.183832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:25.183832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:25.183891 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:25.184125 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:25.184127 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:25.184127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:25.184264 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:25.184332 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:25.184482 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 13:01:25.184609 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":72}
W20260806 13:01:25.186676 23599 tablet.cc:2369] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:25.187400 23241 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:59012:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 13:01:25.187680 23241 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:25.189810 23529 tablet_service.cc:1467] Processing CreateTablet for tablet 30a673da585941438402c39f269db16d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=57bfffbfb0f6481bad58129ee116b18c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:25.189819 23382 tablet_service.cc:1467] Processing CreateTablet for tablet 30a673da585941438402c39f269db16d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=57bfffbfb0f6481bad58129ee116b18c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:25.190052 23529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30a673da585941438402c39f269db16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:25.190059 23382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30a673da585941438402c39f269db16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:25.191872 23767 tablet_bootstrap.cc:492] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: Bootstrap starting.
I20260806 13:01:25.191911 23769 tablet_bootstrap.cc:492] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: Bootstrap starting.
I20260806 13:01:25.192080 23674 tablet_service.cc:1467] Processing CreateTablet for tablet 30a673da585941438402c39f269db16d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=57bfffbfb0f6481bad58129ee116b18c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:25.192305 23674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30a673da585941438402c39f269db16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:25.192451 23769 tablet_bootstrap.cc:654] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:25.192472 23767 tablet_bootstrap.cc:654] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:25.193645 23767 tablet_bootstrap.cc:492] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: No bootstrap required, opened a new log
I20260806 13:01:25.193706 23767 ts_tablet_manager.cc:1397] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260806 13:01:25.193898 23767 raft_consensus.cc:348] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.194006 23767 raft_consensus.cc:374] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:25.194032 23767 raft_consensus.cc:729] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55cd93ba4f1e412d9983e4106dacd399, State: Initialized, Role: FOLLOWER
I20260806 13:01:25.194089 23767 consensus_queue.cc:260] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.194236 23767 ts_tablet_manager.cc:1428] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:25.194384 23768 tablet_bootstrap.cc:492] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: Bootstrap starting.
I20260806 13:01:25.194339 23774 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.194453 23774 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:25.195086 23768 tablet_bootstrap.cc:654] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:25.195953 23768 tablet_bootstrap.cc:492] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: No bootstrap required, opened a new log
I20260806 13:01:25.196010 23768 ts_tablet_manager.cc:1397] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:25.196195 23769 tablet_bootstrap.cc:492] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: No bootstrap required, opened a new log
I20260806 13:01:25.196199 23768 raft_consensus.cc:348] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.196267 23768 raft_consensus.cc:374] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:25.196274 23769 ts_tablet_manager.cc:1397] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260806 13:01:25.196310 23768 raft_consensus.cc:729] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f18f34c804044469ce1bf6f266f0c19, State: Initialized, Role: FOLLOWER
I20260806 13:01:25.196367 23768 consensus_queue.cc:260] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.196460 23768 ts_tablet_manager.cc:1428] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:25.196583 23776 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.196688 23776 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:25.196715 23769 raft_consensus.cc:348] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.196802 23769 raft_consensus.cc:374] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:25.196835 23769 raft_consensus.cc:729] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce90b417be446ae83118bce93c4fce8, State: Initialized, Role: FOLLOWER
I20260806 13:01:25.196902 23769 consensus_queue.cc:260] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.197012 23769 ts_tablet_manager.cc:1428] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:25.197129 23775 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.197224 23775 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:25.251763 23774 raft_consensus.cc:482] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:25.251920 23774 raft_consensus.cc:504] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.252206 23774 leader_election.cc:288] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571), 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171)
I20260806 13:01:25.252436 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30a673da585941438402c39f269db16d" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8" is_pre_election: true
I20260806 13:01:25.252470 23695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30a673da585941438402c39f269db16d" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f18f34c804044469ce1bf6f266f0c19" is_pre_election: true
I20260806 13:01:25.252561 23550 raft_consensus.cc:2454] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 0.
I20260806 13:01:25.252600 23695 raft_consensus.cc:2454] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 0.
I20260806 13:01:25.252801 23334 leader_election.cc:302] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55cd93ba4f1e412d9983e4106dacd399, 9ce90b417be446ae83118bce93c4fce8; no voters:
I20260806 13:01:25.252954 23774 raft_consensus.cc:2781] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:25.253019 23774 raft_consensus.cc:482] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:25.253049 23774 raft_consensus.cc:3037] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.254024 23774 raft_consensus.cc:504] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.254266 23774 leader_election.cc:288] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571), 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171)
I20260806 13:01:25.254514 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30a673da585941438402c39f269db16d" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8"
I20260806 13:01:25.254637 23550 raft_consensus.cc:3037] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.254593 23695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30a673da585941438402c39f269db16d" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f18f34c804044469ce1bf6f266f0c19"
I20260806 13:01:25.254748 23695 raft_consensus.cc:3037] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.255751 23550 raft_consensus.cc:2454] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 1.
I20260806 13:01:25.255751 23695 raft_consensus.cc:2454] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 1.
I20260806 13:01:25.256050 23334 leader_election.cc:302] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55cd93ba4f1e412d9983e4106dacd399, 9ce90b417be446ae83118bce93c4fce8; no voters:
I20260806 13:01:25.256229 23774 raft_consensus.cc:2781] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:25.256328 23774 raft_consensus.cc:686] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [term 1 LEADER]: Becoming Leader. State: Replica: 55cd93ba4f1e412d9983e4106dacd399, State: Running, Role: LEADER
I20260806 13:01:25.256426 23774 consensus_queue.cc:237] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.256897 23779 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: TxnStatusTablet state changed. Reason: New leader 55cd93ba4f1e412d9983e4106dacd399. Latest consensus state: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.257022 23779 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:25.257351 23791 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 13:01:25.257383 23241 catalog_manager.cc:5495] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:25.257544 23791 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 13:01:25.278916 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.274975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56484 (local address 127.20.245.129:40485)
0806 13:01:25.275034 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:25.275037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:25.275083 (+ 46us) server_negotiation.cc:407] Connection header received
0806 13:01:25.275255 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:25.275257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:25.275288 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:25.275373 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:25.275558 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.276392 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.277726 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.278083 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.278196 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.278460 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:25.278612 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:25.278714 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:25.278770 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 13:01:25.278801 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 13:01:25.278919 23786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.274947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40485 (local address 127.0.0.1:56484)
0806 13:01:25.275030 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:25.275043 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:25.275115 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:25.275382 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:25.275383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:25.275386 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:25.275467 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.275470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.276526 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.276528 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.277588 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.277592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.278198 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.278200 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.278298 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.278331 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:25.278691 (+ 360us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:25.278706 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 13:01:25.278763 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 13:01:25.278834 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260806 13:01:25.281812 23550 raft_consensus.cc:1261] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Refusing update from remote peer 55cd93ba4f1e412d9983e4106dacd399: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:25.281812 23695 raft_consensus.cc:1261] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Refusing update from remote peer 55cd93ba4f1e412d9983e4106dacd399: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:25.282274 23774 consensus_queue.cc:1035] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:25.282471 23779 consensus_queue.cc:1035] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:25.284801 23776 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: TxnStatusTablet state changed. Reason: New leader 55cd93ba4f1e412d9983e4106dacd399. Latest consensus state: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.284961 23776 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:25.286850 23775 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: TxnStatusTablet state changed. Reason: New leader 55cd93ba4f1e412d9983e4106dacd399. Latest consensus state: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.286988 23775 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:25.287963 23779 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.288095 23779 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:25.289136 23775 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.289181 23794 mvcc.cc:205] Tried to move back new op lower bound from 7315543184510464000 to 7315543184410947584. Current Snapshot: MvccSnapshot[applied={T|T < 7315543184510464000 or (T in {7315543184510464000})}]
I20260806 13:01:25.289252 23775 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 9ce90b417be446ae83118bce93c4fce8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:25.291050 23779 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.291235 23779 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 55cd93ba4f1e412d9983e4106dacd399: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:25.292063 23776 tablet_replica.cc:439] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } } }
I20260806 13:01:25.292193 23776 tablet_replica.cc:442] T 30a673da585941438402c39f269db16d P 9f18f34c804044469ce1bf6f266f0c19: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:25.294795 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.291469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56492 (local address 127.20.245.129:40485)
0806 13:01:25.291530 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:25.291534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:25.291544 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:01:25.291575 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:25.291576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:25.291591 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:25.291651 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:25.291882 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.292631 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.293904 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.294245 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.294317 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.294496 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:25.294540 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:25.294590 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:25.294667 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 13:01:25.294697 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 13:01:25.303249 23764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.299515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:59397 (local address 127.20.245.129:40485)
0806 13:01:25.299591 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:25.299594 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:25.299736 (+ 142us) server_negotiation.cc:407] Connection header received
0806 13:01:25.299832 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:25.299834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:25.299846 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:25.299906 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:25.300072 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.300898 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.302307 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.302519 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.302607 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.302849 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:25.302893 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:25.302970 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:25.303051 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 13:01:25.303075 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 13:01:25.303256 23805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:25.299451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40485 (local address 127.20.245.129:59397)
0806 13:01:25.299639 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:25.299652 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:25.299731 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:25.299922 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:25.299923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:25.299925 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:25.300000 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.300007 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.301044 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.301045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.302188 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:25.302194 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:25.302608 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:25.302609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:25.302677 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:25.302713 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:25.302989 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:25.302990 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 13:01:25.303031 (+ 41us) client_negotiation.cc:240] Negotiation successful
0806 13:01:25.303107 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
I20260806 13:01:25.307286 23549 raft_consensus.cc:1261] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Refusing update from remote peer 55cd93ba4f1e412d9983e4106dacd399: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:25.307571 23774 consensus_queue.cc:1035] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:25.309226 23695 raft_consensus.cc:1261] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Refusing update from remote peer 55cd93ba4f1e412d9983e4106dacd399: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:25.309479 23779 consensus_queue.cc:1035] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:25.311595 23797 mvcc.cc:205] Tried to move back new op lower bound from 7315543184616226816 to 7315543183819046912. Current Snapshot: MvccSnapshot[applied={T|T < 7315543184616226816}]
I20260806 13:01:25.327603 23241 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:25.327793 23241 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:25.328923 23241 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: Sending DeleteTablet for 3 replicas of tablet 4d0d06efbd5c4889a31c6b8019252703
I20260806 13:01:25.329434 23529 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d0d06efbd5c4889a31c6b8019252703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:25 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:38424
I20260806 13:01:25.329499 23674 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d0d06efbd5c4889a31c6b8019252703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:25 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34666
I20260806 13:01:25.329785 23381 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d0d06efbd5c4889a31c6b8019252703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:25 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:56468
I20260806 13:01:25.330096 23811 tablet_replica.cc:330] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: stopping tablet replica
I20260806 13:01:25.330096 23812 tablet_replica.cc:330] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: stopping tablet replica
I20260806 13:01:25.330252 23812 raft_consensus.cc:2229] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:25.330263 23811 raft_consensus.cc:2229] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:25.330341 23811 raft_consensus.cc:2258] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:25.330391 23812 raft_consensus.cc:2258] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:25.330567 23810 tablet_replica.cc:330] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: stopping tablet replica
I20260806 13:01:25.330713 23810 raft_consensus.cc:2229] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:25.330786 23810 raft_consensus.cc:2258] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:25.330744 23241 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:25.330950 23241 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:25.331120 23811 ts_tablet_manager.cc:1905] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:25.331166 23812 ts_tablet_manager.cc:1905] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:25.331380 23810 ts_tablet_manager.cc:1905] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:25.332955 23529 tablet_service.cc:1467] Processing CreateTablet for tablet 4a91f885e4e54ddb8491cc75e791c247 (DEFAULT_TABLE table=test-table [id=0d22aa259df4490f8845b38b5ef41429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:25.333076 23529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a91f885e4e54ddb8491cc75e791c247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:25.333437 23811 ts_tablet_manager.cc:1918] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:25.333519 23811 log.cc:1196] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/4d0d06efbd5c4889a31c6b8019252703
I20260806 13:01:25.333631 23810 ts_tablet_manager.cc:1918] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:25.333701 23810 log.cc:1196] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/4d0d06efbd5c4889a31c6b8019252703
I20260806 13:01:25.333861 23811 ts_tablet_manager.cc:1939] T 4d0d06efbd5c4889a31c6b8019252703 P 9f18f34c804044469ce1bf6f266f0c19: Deleting consensus metadata
I20260806 13:01:25.334013 23810 ts_tablet_manager.cc:1939] T 4d0d06efbd5c4889a31c6b8019252703 P 9ce90b417be446ae83118bce93c4fce8: Deleting consensus metadata
I20260806 13:01:25.334465 23812 ts_tablet_manager.cc:1918] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:25.334539 23812 log.cc:1196] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/4d0d06efbd5c4889a31c6b8019252703
I20260806 13:01:25.334551 23769 tablet_bootstrap.cc:492] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: Bootstrap starting.
I20260806 13:01:25.334830 23812 ts_tablet_manager.cc:1939] T 4d0d06efbd5c4889a31c6b8019252703 P 55cd93ba4f1e412d9983e4106dacd399: Deleting consensus metadata
I20260806 13:01:25.335079 23769 tablet_bootstrap.cc:654] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:25.335778 23674 tablet_service.cc:1467] Processing CreateTablet for tablet 4a91f885e4e54ddb8491cc75e791c247 (DEFAULT_TABLE table=test-table [id=0d22aa259df4490f8845b38b5ef41429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:25.335500 23225 catalog_manager.cc:4841] TS 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171): tablet 4d0d06efbd5c4889a31c6b8019252703 (table test-table [id=650c1a783f424ac4b58935439df8cdce]) successfully deleted
I20260806 13:01:25.335951 23769 tablet_bootstrap.cc:492] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: No bootstrap required, opened a new log
I20260806 13:01:25.335990 23674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a91f885e4e54ddb8491cc75e791c247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:25.335999 23769 ts_tablet_manager.cc:1397] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:25.336107 23381 tablet_service.cc:1467] Processing CreateTablet for tablet 4a91f885e4e54ddb8491cc75e791c247 (DEFAULT_TABLE table=test-table [id=0d22aa259df4490f8845b38b5ef41429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:25.336170 23769 raft_consensus.cc:348] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.336253 23769 raft_consensus.cc:374] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:25.336274 23769 raft_consensus.cc:729] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce90b417be446ae83118bce93c4fce8, State: Initialized, Role: FOLLOWER
I20260806 13:01:25.336269 23381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a91f885e4e54ddb8491cc75e791c247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:25.336324 23769 consensus_queue.cc:260] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.336411 23769 ts_tablet_manager.cc:1428] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 13:01:25.335559 23227 catalog_manager.cc:4841] TS 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571): tablet 4d0d06efbd5c4889a31c6b8019252703 (table test-table [id=650c1a783f424ac4b58935439df8cdce]) successfully deleted
I20260806 13:01:25.337572 23768 tablet_bootstrap.cc:492] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: Bootstrap starting.
I20260806 13:01:25.337764 23767 tablet_bootstrap.cc:492] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: Bootstrap starting.
I20260806 13:01:25.337819 23225 catalog_manager.cc:4841] TS 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485): tablet 4d0d06efbd5c4889a31c6b8019252703 (table test-table [id=650c1a783f424ac4b58935439df8cdce]) successfully deleted
I20260806 13:01:25.338101 23768 tablet_bootstrap.cc:654] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:25.338276 23767 tablet_bootstrap.cc:654] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:25.339038 23767 tablet_bootstrap.cc:492] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: No bootstrap required, opened a new log
I20260806 13:01:25.339093 23767 ts_tablet_manager.cc:1397] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.001s
I20260806 13:01:25.339339 23768 tablet_bootstrap.cc:492] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: No bootstrap required, opened a new log
I20260806 13:01:25.339313 23767 raft_consensus.cc:348] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.339395 23767 raft_consensus.cc:374] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:25.339394 23768 ts_tablet_manager.cc:1397] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:25.339418 23767 raft_consensus.cc:729] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55cd93ba4f1e412d9983e4106dacd399, State: Initialized, Role: FOLLOWER
I20260806 13:01:25.339463 23767 consensus_queue.cc:260] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.339564 23767 ts_tablet_manager.cc:1428] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:25.339596 23768 raft_consensus.cc:348] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.339694 23768 raft_consensus.cc:374] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:25.339741 23768 raft_consensus.cc:729] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f18f34c804044469ce1bf6f266f0c19, State: Initialized, Role: FOLLOWER
I20260806 13:01:25.339800 23768 consensus_queue.cc:260] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.339910 23768 ts_tablet_manager.cc:1428] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 13:01:25.510643 23808 raft_consensus.cc:482] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:25.510809 23808 raft_consensus.cc:504] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.511096 23808 leader_election.cc:288] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571), 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171)
I20260806 13:01:25.511524 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a91f885e4e54ddb8491cc75e791c247" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8" is_pre_election: true
I20260806 13:01:25.511539 23695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a91f885e4e54ddb8491cc75e791c247" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f18f34c804044469ce1bf6f266f0c19" is_pre_election: true
I20260806 13:01:25.511672 23550 raft_consensus.cc:2454] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 0.
I20260806 13:01:25.511693 23695 raft_consensus.cc:2454] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 0.
I20260806 13:01:25.511911 23334 leader_election.cc:302] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55cd93ba4f1e412d9983e4106dacd399, 9ce90b417be446ae83118bce93c4fce8; no voters:
I20260806 13:01:25.512028 23808 raft_consensus.cc:2781] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:25.512074 23808 raft_consensus.cc:482] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:25.512099 23808 raft_consensus.cc:3037] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.513326 23808 raft_consensus.cc:504] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.513536 23808 leader_election.cc:288] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571), 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171)
I20260806 13:01:25.513785 23695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a91f885e4e54ddb8491cc75e791c247" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f18f34c804044469ce1bf6f266f0c19"
I20260806 13:01:25.513792 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a91f885e4e54ddb8491cc75e791c247" candidate_uuid: "55cd93ba4f1e412d9983e4106dacd399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8"
I20260806 13:01:25.513887 23550 raft_consensus.cc:3037] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.513906 23695 raft_consensus.cc:3037] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:25.514715 23695 raft_consensus.cc:2454] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 1.
I20260806 13:01:25.514861 23550 raft_consensus.cc:2454] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55cd93ba4f1e412d9983e4106dacd399 in term 1.
I20260806 13:01:25.514950 23332 leader_election.cc:302] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55cd93ba4f1e412d9983e4106dacd399, 9f18f34c804044469ce1bf6f266f0c19; no voters:
I20260806 13:01:25.515053 23808 raft_consensus.cc:2781] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:25.515113 23808 raft_consensus.cc:686] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 LEADER]: Becoming Leader. State: Replica: 55cd93ba4f1e412d9983e4106dacd399, State: Running, Role: LEADER
I20260806 13:01:25.515252 23808 consensus_queue.cc:237] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:25.516119 23241 catalog_manager.cc:5495] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "55cd93ba4f1e412d9983e4106dacd399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:25.533819 23550 raft_consensus.cc:1261] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Refusing update from remote peer 55cd93ba4f1e412d9983e4106dacd399: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:25.534055 23695 raft_consensus.cc:1261] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Refusing update from remote peer 55cd93ba4f1e412d9983e4106dacd399: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:25.534142 23774 consensus_queue.cc:1035] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:25.534299 23779 consensus_queue.cc:1035] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 13:01:25.540349 23794 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 13:01:27.067453 23239 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:27.067603 23239 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:27.068966 23239 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: Sending DeleteTablet for 3 replicas of tablet 4a91f885e4e54ddb8491cc75e791c247
I20260806 13:01:27.069346 23382 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a91f885e4e54ddb8491cc75e791c247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:27 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:56468
I20260806 13:01:27.069430 23674 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a91f885e4e54ddb8491cc75e791c247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:27 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34666
I20260806 13:01:27.069438 23529 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a91f885e4e54ddb8491cc75e791c247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:27 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:38424
I20260806 13:01:27.069761 23841 tablet_replica.cc:330] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: stopping tablet replica
I20260806 13:01:27.069792 23840 tablet_replica.cc:330] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: stopping tablet replica
I20260806 13:01:27.069847 23841 raft_consensus.cc:2229] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:27.069943 23841 raft_consensus.cc:2258] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:27.070024 23839 tablet_replica.cc:330] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: stopping tablet replica
I20260806 13:01:27.070107 23839 raft_consensus.cc:2229] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:27.070168 23839 raft_consensus.cc:2258] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:27.070312 23841 ts_tablet_manager.cc:1905] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:27.070416 23840 raft_consensus.cc:2229] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:27.070446 23839 ts_tablet_manager.cc:1905] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:27.070565 23840 raft_consensus.cc:2258] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:27.070955 23840 ts_tablet_manager.cc:1905] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:27.072921 23839 ts_tablet_manager.cc:1918] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 13:01:27.073002 23839 log.cc:1196] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/4a91f885e4e54ddb8491cc75e791c247
I20260806 13:01:27.073259 23841 ts_tablet_manager.cc:1918] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 13:01:27.073305 23839 ts_tablet_manager.cc:1939] T 4a91f885e4e54ddb8491cc75e791c247 P 9f18f34c804044469ce1bf6f266f0c19: Deleting consensus metadata
I20260806 13:01:27.073359 23841 log.cc:1196] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/4a91f885e4e54ddb8491cc75e791c247
I20260806 13:01:27.073716 23840 ts_tablet_manager.cc:1918] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 13:01:27.073777 23841 ts_tablet_manager.cc:1939] T 4a91f885e4e54ddb8491cc75e791c247 P 55cd93ba4f1e412d9983e4106dacd399: Deleting consensus metadata
I20260806 13:01:27.073910 23840 log.cc:1196] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/4a91f885e4e54ddb8491cc75e791c247
I20260806 13:01:27.074113 23225 catalog_manager.cc:4841] TS 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171): tablet 4a91f885e4e54ddb8491cc75e791c247 (table test-table [id=0d22aa259df4490f8845b38b5ef41429]) successfully deleted
I20260806 13:01:27.074362 23840 ts_tablet_manager.cc:1939] T 4a91f885e4e54ddb8491cc75e791c247 P 9ce90b417be446ae83118bce93c4fce8: Deleting consensus metadata
I20260806 13:01:27.074357 23225 catalog_manager.cc:4841] TS 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485): tablet 4a91f885e4e54ddb8491cc75e791c247 (table test-table [id=0d22aa259df4490f8845b38b5ef41429]) successfully deleted
I20260806 13:01:27.074885 23227 catalog_manager.cc:4841] TS 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571): tablet 4a91f885e4e54ddb8491cc75e791c247 (table test-table [id=0d22aa259df4490f8845b38b5ef41429]) successfully deleted
Aug 06 13:01:27 dist-test-slave-srgv krb5kdc[23195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021287, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 13:01:27 dist-test-slave-srgv krb5kdc[23195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021287, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:27.109189 23849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.093040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59020 (local address 127.20.245.190:38067)
0806 13:01:27.093296 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:27.093299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:27.093310 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:27.093348 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:27.093348 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:27.093363 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:27.093441 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:27.094334 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.094936 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.095923 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.096173 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.096291 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.105931 (+ 9640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:27.105934 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:27.105934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:27.105945 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:27.107831 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:27.108291 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:27.108292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:27.108292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:27.108361 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:27.108625 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:27.108626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:27.108626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:27.108790 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:27.108881 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:27.109005 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 13:01:27.109091 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":116,"threads_started":1}
I20260806 13:01:27.111496 23239 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:27.111734 23239 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:27.114078 23674 tablet_service.cc:1467] Processing CreateTablet for tablet e82a4b31d8a44ac6a926aa47f40a79dc (DEFAULT_TABLE table=test-table [id=08b2ec301cbb47e6942f2344e8bc1c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:27.114078 23529 tablet_service.cc:1467] Processing CreateTablet for tablet e82a4b31d8a44ac6a926aa47f40a79dc (DEFAULT_TABLE table=test-table [id=08b2ec301cbb47e6942f2344e8bc1c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:27.114086 23382 tablet_service.cc:1467] Processing CreateTablet for tablet e82a4b31d8a44ac6a926aa47f40a79dc (DEFAULT_TABLE table=test-table [id=08b2ec301cbb47e6942f2344e8bc1c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:27.114288 23529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e82a4b31d8a44ac6a926aa47f40a79dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:27.114288 23674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e82a4b31d8a44ac6a926aa47f40a79dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:27.114306 23382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e82a4b31d8a44ac6a926aa47f40a79dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:27.116286 23850 tablet_bootstrap.cc:492] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: Bootstrap starting.
I20260806 13:01:27.116420 23852 tablet_bootstrap.cc:492] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: Bootstrap starting.
I20260806 13:01:27.117036 23852 tablet_bootstrap.cc:654] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:27.117034 23850 tablet_bootstrap.cc:654] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:27.117578 23851 tablet_bootstrap.cc:492] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: Bootstrap starting.
I20260806 13:01:27.117944 23852 tablet_bootstrap.cc:492] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: No bootstrap required, opened a new log
I20260806 13:01:27.117980 23850 tablet_bootstrap.cc:492] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: No bootstrap required, opened a new log
I20260806 13:01:27.118039 23850 ts_tablet_manager.cc:1397] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:27.118094 23851 tablet_bootstrap.cc:654] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:27.118026 23852 ts_tablet_manager.cc:1397] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:27.118279 23852 raft_consensus.cc:348] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.118233 23850 raft_consensus.cc:348] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.118372 23852 raft_consensus.cc:374] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:27.118373 23850 raft_consensus.cc:374] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:27.118403 23852 raft_consensus.cc:729] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f18f34c804044469ce1bf6f266f0c19, State: Initialized, Role: FOLLOWER
I20260806 13:01:27.118407 23850 raft_consensus.cc:729] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55cd93ba4f1e412d9983e4106dacd399, State: Initialized, Role: FOLLOWER
I20260806 13:01:27.118458 23852 consensus_queue.cc:260] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.118495 23850 consensus_queue.cc:260] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.118634 23850 ts_tablet_manager.cc:1428] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:27.118680 23852 ts_tablet_manager.cc:1428] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:27.119115 23851 tablet_bootstrap.cc:492] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: No bootstrap required, opened a new log
I20260806 13:01:27.119231 23851 ts_tablet_manager.cc:1397] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:27.119451 23851 raft_consensus.cc:348] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.119580 23851 raft_consensus.cc:374] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:27.119614 23851 raft_consensus.cc:729] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce90b417be446ae83118bce93c4fce8, State: Initialized, Role: FOLLOWER
I20260806 13:01:27.119704 23851 consensus_queue.cc:260] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.119967 23851 ts_tablet_manager.cc:1428] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:27.180073 23857 raft_consensus.cc:482] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:27.180259 23857 raft_consensus.cc:504] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.180919 23857 leader_election.cc:288] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485), 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571)
I20260806 13:01:27.185560 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.181410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:58689 (local address 127.20.245.129:40485)
0806 13:01:27.181606 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:27.181608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:27.181616 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:01:27.181648 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:27.181649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:27.181661 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:27.181765 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:27.182289 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.182953 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.184312 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.184926 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.185045 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.185061 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:27.185405 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 13:01:27.185476 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":111,"threads_started":1}
I20260806 13:01:27.185585 23861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.181251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:60119 (local address 127.20.245.130:43571)
0806 13:01:27.181446 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:27.181449 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:27.181463 (+ 14us) server_negotiation.cc:407] Connection header received
0806 13:01:27.181554 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:27.181555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:27.181570 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:27.181678 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:27.181885 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.182612 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.184228 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.185011 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.185086 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.185097 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:27.185448 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 13:01:27.185496 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":109,"threads_started":1}
I20260806 13:01:27.185557 23859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.181099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40485 (local address 127.20.245.131:58689)
0806 13:01:27.181364 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:27.181381 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:27.181472 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:27.181784 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:27.181785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:27.181787 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:27.182189 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:27.182192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.183038 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.183039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:27.184209 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:27.184211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.185104 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.185106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:27.185215 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.185239 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 13:01:27.185294 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 13:01:27.185356 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":10,"thread_start_us":148,"threads_started":1}
I20260806 13:01:27.185925 23404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e82a4b31d8a44ac6a926aa47f40a79dc" candidate_uuid: "9f18f34c804044469ce1bf6f266f0c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55cd93ba4f1e412d9983e4106dacd399" is_pre_election: true
I20260806 13:01:27.186058 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.181151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:43571 (local address 127.20.245.131:60119)
0806 13:01:27.181383 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:27.181393 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:27.181472 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:27.181686 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:27.181687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:27.181689 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:27.181794 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:27.181797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.182730 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.182731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:27.184097 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:27.184101 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.185152 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.185153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:27.185215 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.185247 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 13:01:27.185294 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 13:01:27.185356 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":58,"spinlock_wait_cycles":1408,"thread_start_us":127,"threads_started":1}
I20260806 13:01:27.186127 23404 raft_consensus.cc:2454] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f18f34c804044469ce1bf6f266f0c19 in term 0.
I20260806 13:01:27.186349 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e82a4b31d8a44ac6a926aa47f40a79dc" candidate_uuid: "9f18f34c804044469ce1bf6f266f0c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8" is_pre_election: true
I20260806 13:01:27.186467 23550 raft_consensus.cc:2454] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f18f34c804044469ce1bf6f266f0c19 in term 0.
I20260806 13:01:27.186631 23623 leader_election.cc:302] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55cd93ba4f1e412d9983e4106dacd399, 9f18f34c804044469ce1bf6f266f0c19; no voters:
I20260806 13:01:27.186861 23857 raft_consensus.cc:2781] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:27.186895 23857 raft_consensus.cc:482] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:27.186911 23857 raft_consensus.cc:3037] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:27.187858 23857 raft_consensus.cc:504] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.188028 23857 leader_election.cc:288] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [CANDIDATE]: Term 1 election: Requested vote from peers 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485), 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571)
I20260806 13:01:27.188227 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e82a4b31d8a44ac6a926aa47f40a79dc" candidate_uuid: "9f18f34c804044469ce1bf6f266f0c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8"
I20260806 13:01:27.188230 23404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e82a4b31d8a44ac6a926aa47f40a79dc" candidate_uuid: "9f18f34c804044469ce1bf6f266f0c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55cd93ba4f1e412d9983e4106dacd399"
I20260806 13:01:27.188306 23404 raft_consensus.cc:3037] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:27.188323 23550 raft_consensus.cc:3037] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:27.189024 23550 raft_consensus.cc:2454] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f18f34c804044469ce1bf6f266f0c19 in term 1.
I20260806 13:01:27.189102 23404 raft_consensus.cc:2454] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f18f34c804044469ce1bf6f266f0c19 in term 1.
I20260806 13:01:27.189316 23626 leader_election.cc:302] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce90b417be446ae83118bce93c4fce8, 9f18f34c804044469ce1bf6f266f0c19; no voters:
I20260806 13:01:27.189429 23857 raft_consensus.cc:2781] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:27.189694 23857 raft_consensus.cc:686] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 LEADER]: Becoming Leader. State: Replica: 9f18f34c804044469ce1bf6f266f0c19, State: Running, Role: LEADER
I20260806 13:01:27.189791 23857 consensus_queue.cc:237] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.190677 23239 catalog_manager.cc:5495] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131). New cstate: current_term: 1 leader_uuid: "9f18f34c804044469ce1bf6f266f0c19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } health_report { overall_health: HEALTHY } } }
I20260806 13:01:27.217623 23866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.214458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34680 (local address 127.20.245.131:38171)
0806 13:01:27.214671 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:27.214673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:27.214680 (+ 7us) server_negotiation.cc:407] Connection header received
0806 13:01:27.214745 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:27.214746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:27.214774 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:27.214891 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:27.215107 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.215739 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.216627 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.216883 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.216969 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.217184 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:27.217331 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:27.217430 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:27.217461 (+ 31us) server_negotiation.cc:299] Negotiation successful
0806 13:01:27.217487 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":115,"threads_started":1}
I20260806 13:01:27.224156 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.221353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:33233 (local address 127.20.245.129:40485)
0806 13:01:27.221407 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:27.221409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:27.221502 (+ 93us) server_negotiation.cc:407] Connection header received
0806 13:01:27.221551 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:27.221552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:27.221564 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:27.221618 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:27.221842 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.222364 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.223264 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.223628 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.223713 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.223880 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:27.223915 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:27.223955 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:27.224043 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 13:01:27.224074 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 13:01:27.224139 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.221220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40485 (local address 127.20.245.131:33233)
0806 13:01:27.221415 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:27.221429 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:27.221499 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:27.221659 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:27.221661 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:27.221662 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:27.221746 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:27.221747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.222438 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.222439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:27.223080 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:27.223083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.223715 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.223716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:27.223778 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.223797 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:27.223967 (+ 170us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:27.223968 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 13:01:27.224003 (+ 35us) client_negotiation.cc:240] Negotiation successful
0806 13:01:27.224048 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":112,"threads_started":1}
I20260806 13:01:27.227499 23550 raft_consensus.cc:1261] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Refusing update from remote peer 9f18f34c804044469ce1bf6f266f0c19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:27.227542 23404 raft_consensus.cc:1261] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Refusing update from remote peer 9f18f34c804044469ce1bf6f266f0c19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:27.227896 23863 consensus_queue.cc:1035] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:27.228084 23857 consensus_queue.cc:1035] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:27.229502 23822 mvcc.cc:205] Tried to move back new op lower bound from 7315543192480833536 to 7315543192330207232. Current Snapshot: MvccSnapshot[applied={T|T < 7315543192480833536}]
I20260806 13:01:27.237273 23866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.234435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:54231 (local address 127.20.245.131:38171)
0806 13:01:27.234494 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:27.234496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:27.234684 (+ 188us) server_negotiation.cc:407] Connection header received
0806 13:01:27.234725 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:27.234725 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:27.234736 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:27.234782 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:27.234885 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.235484 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.236456 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.236741 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.236816 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.236972 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:27.237011 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:27.237087 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:27.237150 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 13:01:27.237179 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 13:01:27.237298 23874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:27.234397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:38171 (local address 127.20.245.129:54231)
0806 13:01:27.234606 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:27.234618 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:27.234674 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:27.234783 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:27.234783 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:27.234785 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:27.234848 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:27.234849 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.235556 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.235557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:27.236364 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:27.236368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:27.236815 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:27.236817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:27.236878 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:27.236883 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:27.237087 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:27.237090 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:01:27.237144 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 13:01:27.237208 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":103,"threads_started":1}
I20260806 13:01:27.248175 23241 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:27.248389 23241 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:27.249351 23241 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: Sending DeleteTablet for 3 replicas of tablet e82a4b31d8a44ac6a926aa47f40a79dc
I20260806 13:01:27.249667 23382 tablet_service.cc:1514] Processing DeleteTablet for tablet e82a4b31d8a44ac6a926aa47f40a79dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:27 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:56468
I20260806 13:01:27.249691 23674 tablet_service.cc:1514] Processing DeleteTablet for tablet e82a4b31d8a44ac6a926aa47f40a79dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:27 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34666
I20260806 13:01:27.249819 23839 tablet_replica.cc:330] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: stopping tablet replica
I20260806 13:01:27.249840 23529 tablet_service.cc:1514] Processing DeleteTablet for tablet e82a4b31d8a44ac6a926aa47f40a79dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:27 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:38424
I20260806 13:01:27.249879 23839 raft_consensus.cc:2229] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:27.249961 23841 tablet_replica.cc:330] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: stopping tablet replica
I20260806 13:01:27.249993 23839 raft_consensus.cc:2258] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:27.250037 23841 raft_consensus.cc:2229] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:27.250095 23841 raft_consensus.cc:2258] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:27.250233 23840 tablet_replica.cc:330] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: stopping tablet replica
I20260806 13:01:27.250309 23840 raft_consensus.cc:2229] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:27.250371 23840 raft_consensus.cc:2258] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:27.250633 23241 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:27.250844 23241 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:27.250840 23841 ts_tablet_manager.cc:1905] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:27.250876 23839 ts_tablet_manager.cc:1905] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:27.252828 23841 ts_tablet_manager.cc:1918] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:27.252871 23839 ts_tablet_manager.cc:1918] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:27.252916 23841 log.cc:1196] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/e82a4b31d8a44ac6a926aa47f40a79dc
I20260806 13:01:27.252933 23839 log.cc:1196] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/e82a4b31d8a44ac6a926aa47f40a79dc
I20260806 13:01:27.253190 23841 ts_tablet_manager.cc:1939] T e82a4b31d8a44ac6a926aa47f40a79dc P 55cd93ba4f1e412d9983e4106dacd399: Deleting consensus metadata
I20260806 13:01:27.253203 23839 ts_tablet_manager.cc:1939] T e82a4b31d8a44ac6a926aa47f40a79dc P 9f18f34c804044469ce1bf6f266f0c19: Deleting consensus metadata
I20260806 13:01:27.253718 23225 catalog_manager.cc:4841] TS 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485): tablet e82a4b31d8a44ac6a926aa47f40a79dc (table test-table [id=08b2ec301cbb47e6942f2344e8bc1c51]) successfully deleted
I20260806 13:01:27.253821 23225 catalog_manager.cc:4841] TS 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171): tablet e82a4b31d8a44ac6a926aa47f40a79dc (table test-table [id=08b2ec301cbb47e6942f2344e8bc1c51]) successfully deleted
I20260806 13:01:27.254474 23840 ts_tablet_manager.cc:1905] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:27.256927 23840 ts_tablet_manager.cc:1918] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:27.257000 23840 log.cc:1196] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/e82a4b31d8a44ac6a926aa47f40a79dc
I20260806 13:01:27.257282 23840 ts_tablet_manager.cc:1939] T e82a4b31d8a44ac6a926aa47f40a79dc P 9ce90b417be446ae83118bce93c4fce8: Deleting consensus metadata
I20260806 13:01:27.257817 23227 catalog_manager.cc:4841] TS 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571): tablet e82a4b31d8a44ac6a926aa47f40a79dc (table test-table [id=08b2ec301cbb47e6942f2344e8bc1c51]) successfully deleted
I20260806 13:01:27.257943 23529 tablet_service.cc:1467] Processing CreateTablet for tablet 7806ccbd2d794c37acee4e6da24818dc (DEFAULT_TABLE table=test-table [id=db10af3ba2c54ef08f0d697290940678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:27.258011 23382 tablet_service.cc:1467] Processing CreateTablet for tablet 7806ccbd2d794c37acee4e6da24818dc (DEFAULT_TABLE table=test-table [id=db10af3ba2c54ef08f0d697290940678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:27.258152 23382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7806ccbd2d794c37acee4e6da24818dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:27.258152 23529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7806ccbd2d794c37acee4e6da24818dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:27.259117 23851 tablet_bootstrap.cc:492] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: Bootstrap starting.
I20260806 13:01:27.259334 23674 tablet_service.cc:1467] Processing CreateTablet for tablet 7806ccbd2d794c37acee4e6da24818dc (DEFAULT_TABLE table=test-table [id=db10af3ba2c54ef08f0d697290940678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:27.259495 23674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7806ccbd2d794c37acee4e6da24818dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:27.259667 23851 tablet_bootstrap.cc:654] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:27.260715 23851 tablet_bootstrap.cc:492] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: No bootstrap required, opened a new log
I20260806 13:01:27.260774 23851 ts_tablet_manager.cc:1397] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:27.261133 23851 raft_consensus.cc:348] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.261235 23851 raft_consensus.cc:374] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:27.261262 23851 raft_consensus.cc:729] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce90b417be446ae83118bce93c4fce8, State: Initialized, Role: FOLLOWER
I20260806 13:01:27.261299 23852 tablet_bootstrap.cc:492] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: Bootstrap starting.
I20260806 13:01:27.261324 23850 tablet_bootstrap.cc:492] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399: Bootstrap starting.
I20260806 13:01:27.261313 23851 consensus_queue.cc:260] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.261415 23851 ts_tablet_manager.cc:1428] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:27.261708 23850 tablet_bootstrap.cc:654] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:27.261891 23852 tablet_bootstrap.cc:654] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:27.262552 23850 tablet_bootstrap.cc:492] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399: No bootstrap required, opened a new log
I20260806 13:01:27.262610 23850 ts_tablet_manager.cc:1397] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:27.262740 23850 raft_consensus.cc:348] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.262806 23850 raft_consensus.cc:374] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:27.262820 23850 raft_consensus.cc:729] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55cd93ba4f1e412d9983e4106dacd399, State: Initialized, Role: FOLLOWER
I20260806 13:01:27.262882 23850 consensus_queue.cc:260] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.263011 23850 ts_tablet_manager.cc:1428] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:27.263635 23852 tablet_bootstrap.cc:492] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: No bootstrap required, opened a new log
I20260806 13:01:27.263720 23852 ts_tablet_manager.cc:1397] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:27.264031 23852 raft_consensus.cc:348] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.264106 23852 raft_consensus.cc:374] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:27.264127 23852 raft_consensus.cc:729] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f18f34c804044469ce1bf6f266f0c19, State: Initialized, Role: FOLLOWER
I20260806 13:01:27.264176 23852 consensus_queue.cc:260] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.264377 23852 ts_tablet_manager.cc:1428] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:27.285599 23872 raft_consensus.cc:482] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:27.285745 23872 raft_consensus.cc:504] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.285989 23872 leader_election.cc:288] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485), 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571)
I20260806 13:01:27.286357 23404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7806ccbd2d794c37acee4e6da24818dc" candidate_uuid: "9f18f34c804044469ce1bf6f266f0c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55cd93ba4f1e412d9983e4106dacd399" is_pre_election: true
I20260806 13:01:27.286375 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7806ccbd2d794c37acee4e6da24818dc" candidate_uuid: "9f18f34c804044469ce1bf6f266f0c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8" is_pre_election: true
I20260806 13:01:27.286497 23404 raft_consensus.cc:2454] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f18f34c804044469ce1bf6f266f0c19 in term 0.
I20260806 13:01:27.286515 23550 raft_consensus.cc:2454] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f18f34c804044469ce1bf6f266f0c19 in term 0.
I20260806 13:01:27.286741 23626 leader_election.cc:302] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce90b417be446ae83118bce93c4fce8, 9f18f34c804044469ce1bf6f266f0c19; no voters:
I20260806 13:01:27.286885 23872 raft_consensus.cc:2781] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:27.286939 23872 raft_consensus.cc:482] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:27.286964 23872 raft_consensus.cc:3037] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:27.288717 23872 raft_consensus.cc:504] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.289001 23872 leader_election.cc:288] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [CANDIDATE]: Term 1 election: Requested vote from peers 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485), 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571)
I20260806 13:01:27.289248 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7806ccbd2d794c37acee4e6da24818dc" candidate_uuid: "9f18f34c804044469ce1bf6f266f0c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce90b417be446ae83118bce93c4fce8"
I20260806 13:01:27.289250 23404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7806ccbd2d794c37acee4e6da24818dc" candidate_uuid: "9f18f34c804044469ce1bf6f266f0c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55cd93ba4f1e412d9983e4106dacd399"
I20260806 13:01:27.289374 23404 raft_consensus.cc:3037] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:27.289376 23550 raft_consensus.cc:3037] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:27.290382 23550 raft_consensus.cc:2454] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f18f34c804044469ce1bf6f266f0c19 in term 1.
I20260806 13:01:27.290617 23626 leader_election.cc:302] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce90b417be446ae83118bce93c4fce8, 9f18f34c804044469ce1bf6f266f0c19; no voters:
I20260806 13:01:27.290746 23872 raft_consensus.cc:2781] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:27.290723 23404 raft_consensus.cc:2454] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f18f34c804044469ce1bf6f266f0c19 in term 1.
I20260806 13:01:27.290807 23872 raft_consensus.cc:686] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 LEADER]: Becoming Leader. State: Replica: 9f18f34c804044469ce1bf6f266f0c19, State: Running, Role: LEADER
I20260806 13:01:27.290903 23872 consensus_queue.cc:237] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } }
I20260806 13:01:27.291989 23241 catalog_manager.cc:5495] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131). New cstate: current_term: 1 leader_uuid: "9f18f34c804044469ce1bf6f266f0c19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f18f34c804044469ce1bf6f266f0c19" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 38171 } health_report { overall_health: HEALTHY } } }
I20260806 13:01:27.302845 23404 raft_consensus.cc:1261] T 7806ccbd2d794c37acee4e6da24818dc P 55cd93ba4f1e412d9983e4106dacd399 [term 1 FOLLOWER]: Refusing update from remote peer 9f18f34c804044469ce1bf6f266f0c19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:27.303124 23550 raft_consensus.cc:1261] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Refusing update from remote peer 9f18f34c804044469ce1bf6f266f0c19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:27.303326 23872 consensus_queue.cc:1035] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55cd93ba4f1e412d9983e4106dacd399" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:27.303452 23857 consensus_queue.cc:1035] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce90b417be446ae83118bce93c4fce8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 13:01:27.309904 23822 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 13:01:28.831848 23239 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:28.832011 23239 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:28.833159 23239 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fff9b52ff43745ba865347a15c637ae2: Sending DeleteTablet for 3 replicas of tablet 7806ccbd2d794c37acee4e6da24818dc
I20260806 13:01:28.833551 23529 tablet_service.cc:1514] Processing DeleteTablet for tablet 7806ccbd2d794c37acee4e6da24818dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:28 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:38424
I20260806 13:01:28.833654 23382 tablet_service.cc:1514] Processing DeleteTablet for tablet 7806ccbd2d794c37acee4e6da24818dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:28 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:56468
I20260806 13:01:28.833794 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 23315
I20260806 13:01:28.836205 23674 tablet_service.cc:1514] Processing DeleteTablet for tablet 7806ccbd2d794c37acee4e6da24818dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:28 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34666
I20260806 13:01:28.836462 23905 tablet_replica.cc:330] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: stopping tablet replica
I20260806 13:01:28.836524 23905 raft_consensus.cc:2229] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:28.836588 23905 raft_consensus.cc:2258] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:28.836898 23905 ts_tablet_manager.cc:1905] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:28.837077 23903 tablet_replica.cc:330] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: stopping tablet replica
I20260806 13:01:28.837219 23903 raft_consensus.cc:2229] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:28.837343 23903 raft_consensus.cc:2258] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:28.838712 23905 ts_tablet_manager.cc:1918] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 13:01:28.838786 23905 log.cc:1196] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/7806ccbd2d794c37acee4e6da24818dc
I20260806 13:01:28.839041 23905 ts_tablet_manager.cc:1939] T 7806ccbd2d794c37acee4e6da24818dc P 9f18f34c804044469ce1bf6f266f0c19: Deleting consensus metadata
I20260806 13:01:28.839524 23225 catalog_manager.cc:4841] TS 9f18f34c804044469ce1bf6f266f0c19 (127.20.245.131:38171): tablet 7806ccbd2d794c37acee4e6da24818dc (table test-table [id=db10af3ba2c54ef08f0d697290940678]) successfully deleted
I20260806 13:01:28.842015 23903 ts_tablet_manager.cc:1905] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:28.843750 23903 ts_tablet_manager.cc:1918] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 13:01:28.843822 23903 log.cc:1196] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/7806ccbd2d794c37acee4e6da24818dc
I20260806 13:01:28.844115 23903 ts_tablet_manager.cc:1939] T 7806ccbd2d794c37acee4e6da24818dc P 9ce90b417be446ae83118bce93c4fce8: Deleting consensus metadata
W20260806 13:01:28.844281 23225 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:40485 (error 108)
I20260806 13:01:28.844556 23227 catalog_manager.cc:4841] TS 9ce90b417be446ae83118bce93c4fce8 (127.20.245.130:43571): tablet 7806ccbd2d794c37acee4e6da24818dc (table test-table [id=db10af3ba2c54ef08f0d697290940678]) successfully deleted
I20260806 13:01:28.844682 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 23461
I20260806 13:01:28.845847 23907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:28.844863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40485 (local address 127.0.0.1:56500)
0806 13:01:28.845712 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:28.845799 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:40485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":815,"thread_start_us":84,"threads_started":1}
W20260806 13:01:28.845993 23225 catalog_manager.cc:4584] TS 55cd93ba4f1e412d9983e4106dacd399 (127.20.245.129:40485): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7806ccbd2d794c37acee4e6da24818dc: Network error: Client connection negotiation failed: client connection to 127.20.245.129:40485: connect: Connection refused (error 111)
I20260806 13:01:28.852001 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 23607
I20260806 13:01:28.860096 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 23208
2026-08-06T13:01:28Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6064 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:28 dist-test-slave-srgv krb5kdc[23910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:28 dist-test-slave-srgv krb5kdc[23910](info): set up 2 sockets
Aug 06 13:01:28 dist-test-slave-srgv krb5kdc[23910](info): commencing operation
krb5kdc: starting...
W20260806 13:01:29.983486 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:30.127640 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:39959
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:39959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:30.223749 23923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:30.224078 23923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:30.224121 23923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:30.225484 23923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:30.225562 23923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:30.225587 23923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:30.225620 23923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:30.225665 23923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:30.227528 23923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:39959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:39959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:30.227908 23923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:30.228219 23923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:01:30.234689 23923 server_base.cc:1034] running on GCE node
W20260806 13:01:30.234575 23931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:30.234566 23929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:30.234611 23928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:30.235357 23923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:30.235764 23923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:30.236958 23923 hybrid_clock.cc:648] HybridClock initialized: now 1786021290236948 us; error 64 us; skew 500 ppm
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:30.240319 23923 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:30.240875 23923 webserver.cc:460] Webserver started at http://127.20.245.190:43065/ using document root <none> and password file <none>
I20260806 13:01:30.241159 23923 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:30.241235 23923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:30.241411 23923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:30.242746 23923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "d4a61b20106c4105b31619ebad2647e8"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "35c5233c259d5272db0c8b98e725624c"
server_key_iv: "ba11158f0392ac55342a041047e2e0ae"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.243223 23923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "d4a61b20106c4105b31619ebad2647e8"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "35c5233c259d5272db0c8b98e725624c"
server_key_iv: "ba11158f0392ac55342a041047e2e0ae"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.244845 23923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 13:01:30.245936 23938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.246160 23923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:30.246330 23923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "d4a61b20106c4105b31619ebad2647e8"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "35c5233c259d5272db0c8b98e725624c"
server_key_iv: "ba11158f0392ac55342a041047e2e0ae"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.246421 23923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:30.266853 23923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:30.269634 23923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:30.269819 23923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:30.274717 23923 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:39959
I20260806 13:01:30.274787 23992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:39959 every 8 connection(s)
I20260806 13:01:30.275291 23923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:30.276525 23993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:30.279796 23993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8: Bootstrap starting.
I20260806 13:01:30.280546 23993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:30.280870 23993 log.cc:824] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:30.281788 23993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8: No bootstrap required, opened a new log
I20260806 13:01:30.283895 23993 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a61b20106c4105b31619ebad2647e8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39959 } }
I20260806 13:01:30.284094 23993 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:30.284138 23993 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4a61b20106c4105b31619ebad2647e8, State: Initialized, Role: FOLLOWER
I20260806 13:01:30.284344 23993 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a61b20106c4105b31619ebad2647e8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39959 } }
I20260806 13:01:30.284453 23993 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:30.284485 23993 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:30.284580 23993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:30.284574 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 23923
I20260806 13:01:30.284701 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:30.284916 21462 external_mini_cluster.cc:1428] Setting key 1fef09160fb77858f126a1b2cd0f4866
I20260806 13:01:30.285503 23993 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a61b20106c4105b31619ebad2647e8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39959 } }
I20260806 13:01:30.285662 23993 leader_election.cc:302] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4a61b20106c4105b31619ebad2647e8; no voters:
I20260806 13:01:30.285897 23993 leader_election.cc:288] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:30.285928 23998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:30.286082 23998 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [term 1 LEADER]: Becoming Leader. State: Replica: d4a61b20106c4105b31619ebad2647e8, State: Running, Role: LEADER
I20260806 13:01:30.286194 23998 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a61b20106c4105b31619ebad2647e8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39959 } }
I20260806 13:01:30.286271 23993 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:30.286609 24000 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4a61b20106c4105b31619ebad2647e8. Latest consensus state: current_term: 1 leader_uuid: "d4a61b20106c4105b31619ebad2647e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a61b20106c4105b31619ebad2647e8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39959 } } }
I20260806 13:01:30.286717 24000 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:30.286914 23999 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4a61b20106c4105b31619ebad2647e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a61b20106c4105b31619ebad2647e8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39959 } } }
I20260806 13:01:30.286998 23999 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:30.287154 24002 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:30.287843 24002 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:30.291821 24002 catalog_manager.cc:1347] Generated new cluster ID: fe35979d099b4b7788254dcd0b1d16d2
I20260806 13:01:30.291900 24002 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:30.298530 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:30.285560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48750 (local address 127.20.245.190:39959)
0806 13:01:30.285833 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:30.285853 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:30.285889 (+ 36us) server_negotiation.cc:407] Connection header received
0806 13:01:30.286056 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:30.286080 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:30.286168 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:30.287430 (+ 1262us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:30.287569 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.289275 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.290179 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.290986 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.291146 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:30.294439 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:30.294445 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:30.294445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:30.294463 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:30.296594 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:30.297054 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:30.297058 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:30.297059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:30.297187 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:30.297440 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:30.297441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:30.297441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:30.297762 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:30.297975 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:30.298069 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 13:01:30.298256 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260806 13:01:30.304668 24002 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:30.305371 24002 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:30.311971 24002 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4a61b20106c4105b31619ebad2647e8: Generated new TSK 0
I20260806 13:01:30.312261 24002 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:30.351862 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39959
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:30.467912 24020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:30.468211 24020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:30.468252 24020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:30.469543 24020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:30.469622 24020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:30.469676 24020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:30.471390 24020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:30.471717 24020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:30.472002 24020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:30.478682 24025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:30.478675 24029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:30.478740 24027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:30.479430 24020 server_base.cc:1034] running on GCE node
I20260806 13:01:30.479744 24020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:30.480051 24020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:30.481249 24020 hybrid_clock.cc:648] HybridClock initialized: now 1786021290481225 us; error 44 us; skew 500 ppm
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:30.484424 24020 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:30.485021 24020 webserver.cc:460] Webserver started at http://127.20.245.129:35085/ using document root <none> and password file <none>
I20260806 13:01:30.485316 24020 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:30.485378 24020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:30.485488 24020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:30.486935 24020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "74647f09e84042b9b5bf2757770bc9f6"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "743edc5933e32c366e3ea9fb3c392c00"
server_key_iv: "1002c086a12fb6a30a86d1f69de5fc2e"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.487457 24020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "74647f09e84042b9b5bf2757770bc9f6"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "743edc5933e32c366e3ea9fb3c392c00"
server_key_iv: "1002c086a12fb6a30a86d1f69de5fc2e"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.489161 24020 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 13:01:30.490057 24036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.490324 24020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:30.490422 24020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "74647f09e84042b9b5bf2757770bc9f6"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "743edc5933e32c366e3ea9fb3c392c00"
server_key_iv: "1002c086a12fb6a30a86d1f69de5fc2e"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.490489 24020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:30.501108 24020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:30.503624 24020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:30.503773 24020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:30.504032 24020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:30.504386 24020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:30.504424 24020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.504452 24020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:30.504467 24020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.512305 24020 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:33701
I20260806 13:01:30.512349 24150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:33701 every 8 connection(s)
I20260806 13:01:30.512805 24020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:30.519773 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 24020
I20260806 13:01:30.519927 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:30.520164 21462 external_mini_cluster.cc:1428] Setting key 5e14f67319c9061c441483d11613062a
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:30.524869 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:30.513772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:55199 (local address 127.20.245.190:39959)
0806 13:01:30.513887 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:30.513891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:30.514104 (+ 213us) server_negotiation.cc:407] Connection header received
0806 13:01:30.514752 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:30.514753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:30.514768 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:30.514842 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:30.516041 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.516650 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.517771 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.518024 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.518127 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:30.521262 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:30.521264 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:30.521264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:30.521272 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:30.523152 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:30.523669 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:30.523671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:30.523672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:30.523749 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:30.524037 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:30.524039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:30.524039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:30.524191 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:30.524260 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:30.524626 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 13:01:30.524742 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 13:01:30.525105 24153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:30.513712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39959 (local address 127.20.245.129:55199)
0806 13:01:30.513920 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:30.513964 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:30.514590 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:30.514935 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:30.514939 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:30.515629 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:30.515907 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:30.515914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.516758 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.516759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:30.517668 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:30.517670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.518134 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.518135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:30.518300 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:30.519034 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:30.519045 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:30.521130 (+ 2085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:30.523283 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:30.523300 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:30.523303 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:30.523582 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:30.523830 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:30.523830 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:30.523831 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:30.523965 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:30.524285 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:30.524291 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:30.524451 (+ 160us) client_negotiation.cc:769] Sending connection context
0806 13:01:30.524594 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 13:01:30.524799 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":117,"threads_started":1}
I20260806 13:01:30.525743 24151 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39959
I20260806 13:01:30.525887 24151 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:30.526160 24151 heartbeater.cc:511] Master 127.20.245.190:39959 requested a full tablet report, sending...
I20260806 13:01:30.526903 23955 ts_manager.cc:194] Registered new tserver with Master: 74647f09e84042b9b5bf2757770bc9f6 (127.20.245.129:33701)
I20260806 13:01:30.527720 23955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:55199
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:30.551051 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39959
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:30.645479 24156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:30.645810 24156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:30.645856 24156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:30.647122 24156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:30.647220 24156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:30.647265 24156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:30.648823 24156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:30.649133 24156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:30.649420 24156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:30.655880 24161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:30.655943 24164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:30.655968 24156 server_base.cc:1034] running on GCE node
W20260806 13:01:30.655865 24162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:30.656387 24156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:30.656677 24156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:30.657830 24156 hybrid_clock.cc:648] HybridClock initialized: now 1786021290657793 us; error 60 us; skew 500 ppm
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:30.660925 24156 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:30.661446 24156 webserver.cc:460] Webserver started at http://127.20.245.130:35327/ using document root <none> and password file <none>
I20260806 13:01:30.661712 24156 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:30.661762 24156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:30.661890 24156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:30.663311 24156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "08a9eb34af574768b00ea290acb7ee59"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "61c80d3424a06dba8d86ed409c2267ef"
server_key_iv: "59b53a7bba894de29171119d446bfcb8"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.663780 24156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "08a9eb34af574768b00ea290acb7ee59"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "61c80d3424a06dba8d86ed409c2267ef"
server_key_iv: "59b53a7bba894de29171119d446bfcb8"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.665361 24156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 13:01:30.666201 24171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.666420 24156 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:30.666515 24156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "08a9eb34af574768b00ea290acb7ee59"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "61c80d3424a06dba8d86ed409c2267ef"
server_key_iv: "59b53a7bba894de29171119d446bfcb8"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.666572 24156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:30.688161 24156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:30.690930 24156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:30.691072 24156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:30.691344 24156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:30.691751 24156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:30.691789 24156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.691836 24156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:30.691866 24156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.699046 24156 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:45515
I20260806 13:01:30.699136 24285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:45515 every 8 connection(s)
I20260806 13:01:30.699542 24156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:30.708103 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 24156
I20260806 13:01:30.708233 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:30.708458 21462 external_mini_cluster.cc:1428] Setting key 4be2271e0e8a4790a7acc76ab6084dc5
I20260806 13:01:30.712303 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:30.700564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:40615 (local address 127.20.245.190:39959)
0806 13:01:30.700644 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:30.700646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:30.700902 (+ 256us) server_negotiation.cc:407] Connection header received
0806 13:01:30.701514 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:30.701515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:30.701529 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:30.701592 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:30.702736 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.703393 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.704732 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.705189 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.705286 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:30.708022 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:30.708025 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:30.708025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:30.708035 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:30.710349 (+ 2314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:30.711037 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:30.711038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:30.711039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:30.711106 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:30.711491 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:30.711492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:30.711492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:30.711623 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:30.711683 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:30.712110 (+ 427us) server_negotiation.cc:299] Negotiation successful
0806 13:01:30.712198 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:01:30.712742 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:30.700524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39959 (local address 127.20.245.130:40615)
0806 13:01:30.700746 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:30.700793 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:30.701399 (+ 606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:30.701674 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:30.701678 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:30.702367 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:30.702613 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:30.702619 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.703485 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.703486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:30.704586 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:30.704590 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.705347 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.705350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:30.705510 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:30.706101 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:30.706111 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:30.707897 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:30.710489 (+ 2592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:30.710503 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:30.710506 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:30.710914 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:30.711206 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:30.711207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:30.711207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:30.711409 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:30.711699 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:30.711706 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:30.711939 (+ 233us) client_negotiation.cc:769] Sending connection context
0806 13:01:30.712101 (+ 162us) client_negotiation.cc:240] Negotiation successful
0806 13:01:30.712362 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":150,"threads_started":1}
I20260806 13:01:30.713413 24286 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39959
I20260806 13:01:30.713567 24286 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:30.713838 24286 heartbeater.cc:511] Master 127.20.245.190:39959 requested a full tablet report, sending...
I20260806 13:01:30.714385 23955 ts_manager.cc:194] Registered new tserver with Master: 08a9eb34af574768b00ea290acb7ee59 (127.20.245.130:45515)
I20260806 13:01:30.714802 23955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:40615
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:30.742476 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39959
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:30.844820 24291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:30.845374 24291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:30.845427 24291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:30.846876 24291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:30.846932 24291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:30.846964 24291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:30.848672 24291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:30.848980 24291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:30.849267 24291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:30.854961 24296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:30.855017 24297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:30.855046 24299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:30.855199 24291 server_base.cc:1034] running on GCE node
I20260806 13:01:30.855422 24291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:30.855723 24291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:30.856880 24291 hybrid_clock.cc:648] HybridClock initialized: now 1786021290856868 us; error 31 us; skew 500 ppm
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:30.859869 24291 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:30.860416 24291 webserver.cc:460] Webserver started at http://127.20.245.131:39421/ using document root <none> and password file <none>
I20260806 13:01:30.860692 24291 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:30.860767 24291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:30.860934 24291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:30.862180 24291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "a4e6c60466a242368bd47255513d0f26"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "90a04cfaf69375f80823fdb3b8643e75"
server_key_iv: "edf17c2dbb1e5a852c50932b64913491"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.862597 24291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "a4e6c60466a242368bd47255513d0f26"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "90a04cfaf69375f80823fdb3b8643e75"
server_key_iv: "edf17c2dbb1e5a852c50932b64913491"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.864198 24291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 13:01:30.865005 24306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.865186 24291 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:30.865300 24291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "a4e6c60466a242368bd47255513d0f26"
format_stamp: "Formatted at 2026-08-06 13:01:30 on dist-test-slave-srgv"
server_key: "90a04cfaf69375f80823fdb3b8643e75"
server_key_iv: "edf17c2dbb1e5a852c50932b64913491"
server_key_version: "encryptionkey@0"
I20260806 13:01:30.865379 24291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:30.881376 24291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:30.884356 24291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:30.884548 24291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:30.884893 24291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:30.885376 24291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:30.885423 24291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.885457 24291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:30.885481 24291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:30.893112 24291 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:44989
I20260806 13:01:30.893162 24422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:44989 every 8 connection(s)
I20260806 13:01:30.893648 24291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:30.899434 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 24291
I20260806 13:01:30.899564 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:30.899799 21462 external_mini_cluster.cc:1428] Setting key ba8a66d0dcb95fd22209d799924e145f
Aug 06 13:01:30 dist-test-slave-srgv krb5kdc[23910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021290, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:30.905210 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:30.894636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:34511 (local address 127.20.245.190:39959)
0806 13:01:30.894717 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:30.894720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:30.894948 (+ 228us) server_negotiation.cc:407] Connection header received
0806 13:01:30.895654 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:30.895656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:30.895671 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:30.895746 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:30.896873 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.897433 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.898524 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.898755 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.898819 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:30.901779 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:30.901781 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:30.901781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:30.901792 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:30.903334 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:30.904048 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:30.904049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:30.904050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:30.904119 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:30.904456 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:30.904457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:30.904457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:30.904608 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:30.904673 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:30.905039 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 13:01:30.905124 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 13:01:30.905457 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:30.894586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39959 (local address 127.20.245.131:34511)
0806 13:01:30.894792 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:30.894839 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:30.895527 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:30.895829 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:30.895833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:30.896509 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:30.896768 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:30.896774 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.897524 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.897525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:30.898430 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:30.898433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:30.898841 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:30.898842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:30.898955 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:30.899708 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:30.899720 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:30.901646 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:30.903449 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:30.903459 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:30.903462 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:30.903807 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:30.904219 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:30.904220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:30.904221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:30.904379 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:30.904707 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:30.904714 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:30.904898 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 13:01:30.905006 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 13:01:30.905175 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":108,"threads_started":1}
I20260806 13:01:30.906049 24423 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39959
I20260806 13:01:30.906189 24423 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:30.906441 24423 heartbeater.cc:511] Master 127.20.245.190:39959 requested a full tablet report, sending...
I20260806 13:01:30.906946 23955 ts_manager.cc:194] Registered new tserver with Master: a4e6c60466a242368bd47255513d0f26 (127.20.245.131:44989)
I20260806 13:01:30.907482 23955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:34511
I20260806 13:01:30.912386 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 13:01:30.928225 23997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:30.926730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.20.245.190:39959)
0806 13:01:30.926839 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:30.926841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:30.926974 (+ 133us) server_negotiation.cc:407] Connection header received
0806 13:01:30.927033 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:30.927035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:30.927047 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:30.927117 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:30.928019 (+ 902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48754: BlockingRecv error: recv got EOF from 127.0.0.1:48754 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 13:01:30.929154 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 24020
I20260806 13:01:30.935410 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 24156
I20260806 13:01:30.941020 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 24291
I20260806 13:01:30.946687 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 23923
2026-08-06T13:01:30Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2084 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:31 dist-test-slave-srgv krb5kdc[24435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:31 dist-test-slave-srgv krb5kdc[24435](info): set up 2 sockets
Aug 06 13:01:31 dist-test-slave-srgv krb5kdc[24435](info): commencing operation
krb5kdc: starting...
W20260806 13:01:32.028846 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:32 dist-test-slave-srgv krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:32.183223 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36633
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:41435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:36633
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:32.287159 24448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:32.287529 24448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:32.287559 24448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:32.289149 24448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:32.289251 24448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:32.289268 24448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:32.289281 24448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:32.289294 24448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:32.291661 24448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:41435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:36633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:32.292092 24448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:32.292434 24448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:01:32.299273 24448 server_base.cc:1034] running on GCE node
W20260806 13:01:32.299141 24453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:32.299141 24456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:32.299165 24454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:32.299785 24448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:32.300237 24448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:32.301432 24448 hybrid_clock.cc:648] HybridClock initialized: now 1786021292301377 us; error 90 us; skew 500 ppm
Aug 06 13:01:32 dist-test-slave-srgv krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021292, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:32.311314 24448 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:32.311925 24448 webserver.cc:460] Webserver started at http://127.20.245.190:35409/ using document root <none> and password file <none>
I20260806 13:01:32.312197 24448 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:32.312278 24448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:32.312454 24448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:32.313954 24448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "858afbcc98324d9d89fec59506fff1b5"
format_stamp: "Formatted at 2026-08-06 13:01:32 on dist-test-slave-srgv"
server_key: "cb7ae3a54b8dc47cf6177a6e016d6662"
server_key_iv: "29d03dc9aff539a5c83e56b301061842"
server_key_version: "encryptionkey@0"
I20260806 13:01:32.314429 24448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "858afbcc98324d9d89fec59506fff1b5"
format_stamp: "Formatted at 2026-08-06 13:01:32 on dist-test-slave-srgv"
server_key: "cb7ae3a54b8dc47cf6177a6e016d6662"
server_key_iv: "29d03dc9aff539a5c83e56b301061842"
server_key_version: "encryptionkey@0"
I20260806 13:01:32.316346 24448 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 13:01:32.317426 24463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:32.317667 24448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:32.317796 24448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "858afbcc98324d9d89fec59506fff1b5"
format_stamp: "Formatted at 2026-08-06 13:01:32 on dist-test-slave-srgv"
server_key: "cb7ae3a54b8dc47cf6177a6e016d6662"
server_key_iv: "29d03dc9aff539a5c83e56b301061842"
server_key_version: "encryptionkey@0"
I20260806 13:01:32.317891 24448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:32.329566 24448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:32.333423 24448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:32.333639 24448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:32.339041 24448 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:36633
I20260806 13:01:32.339079 24517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:36633 every 8 connection(s)
I20260806 13:01:32.339829 24448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:32.340802 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 24448
I20260806 13:01:32.340834 24518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:32.340978 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:32.341288 21462 external_mini_cluster.cc:1428] Setting key e150c98f61a7ee56dc3d50442b474c48
I20260806 13:01:32.345248 24518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5: Bootstrap starting.
I20260806 13:01:32.346261 24518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:32.346652 24518 log.cc:824] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:32.347726 24518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5: No bootstrap required, opened a new log
Aug 06 13:01:32 dist-test-slave-srgv krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:32.350708 24518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858afbcc98324d9d89fec59506fff1b5" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36633 } }
I20260806 13:01:32.350943 24518 raft_consensus.cc:374] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:32.350999 24518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858afbcc98324d9d89fec59506fff1b5, State: Initialized, Role: FOLLOWER
I20260806 13:01:32.351255 24518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858afbcc98324d9d89fec59506fff1b5" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36633 } }
I20260806 13:01:32.351377 24518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:32.351420 24518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:32.351487 24518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:32.352530 24518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858afbcc98324d9d89fec59506fff1b5" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36633 } }
I20260806 13:01:32.352669 24518 leader_election.cc:302] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 858afbcc98324d9d89fec59506fff1b5; no voters:
I20260806 13:01:32.352945 24518 leader_election.cc:288] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:32.353022 24523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:32.353258 24523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [term 1 LEADER]: Becoming Leader. State: Replica: 858afbcc98324d9d89fec59506fff1b5, State: Running, Role: LEADER
I20260806 13:01:32.353334 24518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:32.353428 24523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858afbcc98324d9d89fec59506fff1b5" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36633 } }
I20260806 13:01:32.353905 24525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 858afbcc98324d9d89fec59506fff1b5. Latest consensus state: current_term: 1 leader_uuid: "858afbcc98324d9d89fec59506fff1b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858afbcc98324d9d89fec59506fff1b5" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36633 } } }
I20260806 13:01:32.353901 24524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "858afbcc98324d9d89fec59506fff1b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "858afbcc98324d9d89fec59506fff1b5" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36633 } } }
I20260806 13:01:32.354003 24525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:32.354003 24524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:32.355098 24529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:32.355722 24521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:32.342080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46440 (local address 127.20.245.190:36633)
0806 13:01:32.342337 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:32.342349 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:32.342386 (+ 37us) server_negotiation.cc:407] Connection header received
0806 13:01:32.342964 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:32.342974 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:32.343050 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:32.343315 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:32.344270 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:32.345478 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:32.346674 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:32.347284 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:32.347384 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:32.350579 (+ 3195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:32.350585 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:32.350586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:32.350603 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:32.353018 (+ 2415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:32.353589 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:32.353593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:32.353593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:32.353726 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:32.353956 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:32.353957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:32.353958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:32.354426 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:32.354598 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:32.355284 (+ 686us) server_negotiation.cc:299] Negotiation successful
0806 13:01:32.355474 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":122,"threads_started":1}
I20260806 13:01:32.356389 24529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:32.357054 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:01:32.358492 24529 catalog_manager.cc:1347] Generated new cluster ID: 730db37050394a7d8ebf38f102edb252
I20260806 13:01:32.358553 24529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:32.369510 24529 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:32.370579 24529 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:32.374464 24529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 858afbcc98324d9d89fec59506fff1b5: Generated new TSK 0
I20260806 13:01:32.374747 24529 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:01:32.381956 24521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:32.376886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46446 (local address 127.20.245.190:36633)
0806 13:01:32.376972 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:32.376975 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:32.377150 (+ 175us) server_negotiation.cc:407] Connection header received
0806 13:01:32.377236 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:32.377237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:32.377255 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:32.377323 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:32.377887 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:32.378767 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:32.379803 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:32.380168 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:32.380269 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:32.381271 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:32.381273 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:32.381273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:32.381621 (+ 348us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:32.381649 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:32.381658 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:32.381722 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:32.381805 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 13:01:32.381850 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 13:01:32.385949 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 24448
2026-08-06T13:01:32Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1437 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:32 dist-test-slave-srgv krb5kdc[24551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:32 dist-test-slave-srgv krb5kdc[24551](info): set up 2 sockets
Aug 06 13:01:32 dist-test-slave-srgv krb5kdc[24551](info): commencing operation
krb5kdc: starting...
W20260806 13:01:33.541850 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:33 dist-test-slave-srgv krb5kdc[24551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:33.695860 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46865
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:46865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:33.808785 24564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:33.809113 24564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:33.809146 24564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:33.810758 24564 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:33.810838 24564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:33.810855 24564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:33.810869 24564 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:33.810882 24564 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:33.812944 24564 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:46865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:33.813336 24564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:33.813655 24564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:33.819816 24572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:33.819810 24569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:33.819839 24570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:33.820129 24564 server_base.cc:1034] running on GCE node
I20260806 13:01:33.820565 24564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:33.821035 24564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:33.822293 24564 hybrid_clock.cc:648] HybridClock initialized: now 1786021293822266 us; error 50 us; skew 500 ppm
Aug 06 13:01:33 dist-test-slave-srgv krb5kdc[24551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021293, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:33.825901 24564 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:33.826516 24564 webserver.cc:460] Webserver started at http://127.20.245.190:38525/ using document root <none> and password file <none>
I20260806 13:01:33.826787 24564 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:33.826839 24564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:33.826961 24564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:33.828428 24564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "98c99993af2449d98aef40eab41d9bc9"
format_stamp: "Formatted at 2026-08-06 13:01:33 on dist-test-slave-srgv"
server_key: "5364a302326097e214bc49f3799f9854"
server_key_iv: "f97dc96e736c2fed7848224b20c82e7f"
server_key_version: "encryptionkey@0"
I20260806 13:01:33.828847 24564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "98c99993af2449d98aef40eab41d9bc9"
format_stamp: "Formatted at 2026-08-06 13:01:33 on dist-test-slave-srgv"
server_key: "5364a302326097e214bc49f3799f9854"
server_key_iv: "f97dc96e736c2fed7848224b20c82e7f"
server_key_version: "encryptionkey@0"
I20260806 13:01:33.830633 24564 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260806 13:01:33.831761 24579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:33.831995 24564 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:33.832098 24564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "98c99993af2449d98aef40eab41d9bc9"
format_stamp: "Formatted at 2026-08-06 13:01:33 on dist-test-slave-srgv"
server_key: "5364a302326097e214bc49f3799f9854"
server_key_iv: "f97dc96e736c2fed7848224b20c82e7f"
server_key_version: "encryptionkey@0"
I20260806 13:01:33.832180 24564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:33.855396 24564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:33.858529 24564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:33.858688 24564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:33.864039 24564 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:46865
I20260806 13:01:33.864166 24633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:46865 every 8 connection(s)
I20260806 13:01:33.864606 24564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:33.866309 24634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:33.869901 24634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9: Bootstrap starting.
I20260806 13:01:33.870906 24634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:33.871428 24634 log.cc:824] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:33.872702 24634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9: No bootstrap required, opened a new log
I20260806 13:01:33.874279 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 24564
I20260806 13:01:33.874383 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:33.874603 21462 external_mini_cluster.cc:1428] Setting key 794e8928184abdc83e9663d953b5b27e
I20260806 13:01:33.875846 24634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c99993af2449d98aef40eab41d9bc9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46865 } }
I20260806 13:01:33.876175 24634 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:33.876232 24634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98c99993af2449d98aef40eab41d9bc9, State: Initialized, Role: FOLLOWER
I20260806 13:01:33.876421 24634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c99993af2449d98aef40eab41d9bc9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46865 } }
I20260806 13:01:33.876551 24634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:33.876660 24634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:33.876748 24634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:33.877954 24634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c99993af2449d98aef40eab41d9bc9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46865 } }
I20260806 13:01:33.878132 24634 leader_election.cc:302] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98c99993af2449d98aef40eab41d9bc9; no voters:
I20260806 13:01:33.878393 24634 leader_election.cc:288] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:33.878465 24639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:33.878638 24639 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [term 1 LEADER]: Becoming Leader. State: Replica: 98c99993af2449d98aef40eab41d9bc9, State: Running, Role: LEADER
I20260806 13:01:33.878777 24634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:33.878813 24639 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c99993af2449d98aef40eab41d9bc9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46865 } }
I20260806 13:01:33.879426 24640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98c99993af2449d98aef40eab41d9bc9. Latest consensus state: current_term: 1 leader_uuid: "98c99993af2449d98aef40eab41d9bc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c99993af2449d98aef40eab41d9bc9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46865 } } }
I20260806 13:01:33.879684 24640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:33.880415 24648 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:33.880703 24641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98c99993af2449d98aef40eab41d9bc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c99993af2449d98aef40eab41d9bc9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46865 } } }
I20260806 13:01:33.880985 24641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:33.881444 24648 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:33.883937 24648 catalog_manager.cc:1347] Generated new cluster ID: ecf315022ce040098aa4ef639e948505
I20260806 13:01:33.884021 24648 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:01:33 dist-test-slave-srgv krb5kdc[24551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:33.890519 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:33.875544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60094 (local address 127.20.245.190:46865)
0806 13:01:33.875882 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:33.875898 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:33.875949 (+ 51us) server_negotiation.cc:407] Connection header received
0806 13:01:33.876120 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:33.876131 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:33.876222 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:33.876438 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:33.877377 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:33.879127 (+ 1750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:33.880487 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:33.881344 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:33.881511 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:33.885287 (+ 3776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:33.885295 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:33.885295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:33.885320 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:33.887760 (+ 2440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:33.888468 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:33.888474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:33.888474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:33.888673 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:33.889014 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:33.889016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:33.889016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:33.889413 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:33.889725 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:33.889834 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 13:01:33.890068 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":169,"threads_started":1}
I20260806 13:01:33.896682 24648 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:33.897452 24648 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:33.903352 24648 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98c99993af2449d98aef40eab41d9bc9: Generated new TSK 0
I20260806 13:01:33.903654 24648 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:33.943571 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46865
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:34.063894 24661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:34.064203 24661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:34.064236 24661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:34.065725 24661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:34.065805 24661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:34.065840 24661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:34.067991 24661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:34.068352 24661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:34.068641 24661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:34.075578 24666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:34.075585 24669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:34.075578 24667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:34.076571 24661 server_base.cc:1034] running on GCE node
I20260806 13:01:34.076929 24661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:34.077312 24661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:34.078581 24661 hybrid_clock.cc:648] HybridClock initialized: now 1786021294078548 us; error 60 us; skew 500 ppm
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[24551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021294, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:34.082993 24661 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:34.083864 24661 webserver.cc:460] Webserver started at http://127.20.245.129:40657/ using document root <none> and password file <none>
I20260806 13:01:34.084260 24661 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:34.084367 24661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:34.084582 24661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:34.086189 24661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "54344491664545118351fe9aab253aa7"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "c1043a21ffdc929851752be3e5579da1"
server_key_iv: "1c2de8cc10c684944b72681d58c40027"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.086776 24661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "54344491664545118351fe9aab253aa7"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "c1043a21ffdc929851752be3e5579da1"
server_key_iv: "1c2de8cc10c684944b72681d58c40027"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.089141 24661 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.004s
I20260806 13:01:34.090438 24676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.090797 24661 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:34.090969 24661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "54344491664545118351fe9aab253aa7"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "c1043a21ffdc929851752be3e5579da1"
server_key_iv: "1c2de8cc10c684944b72681d58c40027"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.091120 24661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:34.105206 24661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:34.108843 24661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:34.109227 24661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:34.109570 24661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:34.110054 24661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:34.110100 24661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.110131 24661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:34.110152 24661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.118266 24661 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:33817
I20260806 13:01:34.118328 24790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:33817 every 8 connection(s)
I20260806 13:01:34.118830 24661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:34.121857 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 24661
I20260806 13:01:34.121981 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:34.122280 21462 external_mini_cluster.cc:1428] Setting key eb2e100bd5f6b8b27b5f01c9cf7db78b
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[24551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021294, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:01:34.134704 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:34.120164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:38245 (local address 127.20.245.190:46865)
0806 13:01:34.120346 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:34.120358 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:34.120555 (+ 197us) server_negotiation.cc:407] Connection header received
0806 13:01:34.121714 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:34.121717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:34.121742 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:34.121823 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:34.123962 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.124565 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.126270 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.126532 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.126615 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:34.130440 (+ 3825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:34.130443 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:34.130443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:34.130456 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:34.132572 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:34.133236 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:34.133238 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:34.133239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:34.133324 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:34.133674 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:34.133675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:34.133676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:34.133845 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:34.133949 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:34.134461 (+ 512us) server_negotiation.cc:299] Negotiation successful
0806 13:01:34.134603 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 13:01:34.134910 24793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:34.119988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46865 (local address 127.20.245.129:38245)
0806 13:01:34.120368 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:34.120422 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:34.121548 (+ 1126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:34.121953 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:34.121959 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:34.123288 (+ 1329us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:34.123821 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:34.123832 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.124705 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.124706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:34.126086 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:34.126092 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.126658 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.126659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:34.126862 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:34.127758 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:34.127772 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:34.130239 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:34.132727 (+ 2488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:34.132743 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:34.132747 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:34.133121 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:34.133433 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:34.133435 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:34.133435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:34.133592 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:34.133963 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:34.133974 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:34.134246 (+ 272us) client_negotiation.cc:769] Sending connection context
0806 13:01:34.134401 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 13:01:34.134603 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":149,"threads_started":1}
I20260806 13:01:34.135839 24791 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46865
I20260806 13:01:34.135974 24791 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:34.136198 24791 heartbeater.cc:511] Master 127.20.245.190:46865 requested a full tablet report, sending...
I20260806 13:01:34.137204 24596 ts_manager.cc:194] Registered new tserver with Master: 54344491664545118351fe9aab253aa7 (127.20.245.129:33817)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
I20260806 13:01:34.138082 24596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:38245
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:34.159754 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46865
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:34.268066 24796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:34.268386 24796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:34.268420 24796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:34.269981 24796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:34.270059 24796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:34.270097 24796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:34.272084 24796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:34.272480 24796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:34.272806 24796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:34.279841 24802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:34.279961 24801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:34.279914 24804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:34.280970 24796 server_base.cc:1034] running on GCE node
I20260806 13:01:34.281363 24796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:34.281719 24796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:34.282909 24796 hybrid_clock.cc:648] HybridClock initialized: now 1786021294282879 us; error 48 us; skew 500 ppm
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[24551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021294, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:34.287441 24796 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:34.288219 24796 webserver.cc:460] Webserver started at http://127.20.245.130:46067/ using document root <none> and password file <none>
I20260806 13:01:34.288564 24796 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:34.288652 24796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:34.288856 24796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:34.290369 24796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "9da9d4825a1745aa949dab0f99057d69"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "50baa55dd3952aed1849c39b9f92a7fd"
server_key_iv: "492c016b39ab7e9d9640654be98cd05c"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.290910 24796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "9da9d4825a1745aa949dab0f99057d69"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "50baa55dd3952aed1849c39b9f92a7fd"
server_key_iv: "492c016b39ab7e9d9640654be98cd05c"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.293038 24796 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:34.294484 24811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.294878 24796 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:34.295014 24796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "9da9d4825a1745aa949dab0f99057d69"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "50baa55dd3952aed1849c39b9f92a7fd"
server_key_iv: "492c016b39ab7e9d9640654be98cd05c"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.295200 24796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:34.319913 24796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:34.322991 24796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:34.323155 24796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:34.323596 24796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:34.324028 24796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:34.324067 24796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.324096 24796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:34.324110 24796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.332930 24796 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:42193
I20260806 13:01:34.333032 24925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:42193 every 8 connection(s)
I20260806 13:01:34.333590 24796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:34.338444 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 24796
I20260806 13:01:34.338649 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:34.338953 21462 external_mini_cluster.cc:1428] Setting key 7a908f77f9bf00c73263e9b1b5b88dd7
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[24551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021294, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:34.348708 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:34.335059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:36681 (local address 127.20.245.190:46865)
0806 13:01:34.335315 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:34.335318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:34.335484 (+ 166us) server_negotiation.cc:407] Connection header received
0806 13:01:34.336355 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:34.336357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:34.336376 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:34.336449 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:34.337750 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.338381 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.340014 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.340427 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.340537 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:34.344180 (+ 3643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:34.344183 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:34.344184 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:34.344196 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:34.346487 (+ 2291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:34.347349 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:34.347352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:34.347353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:34.347445 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:34.347807 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:34.347808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:34.347809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:34.347966 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:34.348049 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:34.348425 (+ 376us) server_negotiation.cc:299] Negotiation successful
0806 13:01:34.348570 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260806 13:01:34.348966 24928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:34.334978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46865 (local address 127.20.245.130:36681)
0806 13:01:34.335288 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:34.335353 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:34.336211 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:34.336550 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:34.336554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:34.337314 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:34.337618 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:34.337624 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.338529 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.338530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:34.339857 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:34.339862 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.340563 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.340564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:34.340769 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:34.341671 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:34.341684 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:34.344006 (+ 2322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:34.346633 (+ 2627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:34.346650 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:34.346655 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:34.347235 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:34.347532 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:34.347533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:34.347534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:34.347717 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:34.348048 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:34.348059 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:34.348265 (+ 206us) client_negotiation.cc:769] Sending connection context
0806 13:01:34.348390 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 13:01:34.348626 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":125,"threads_started":1}
I20260806 13:01:34.349828 24926 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46865
I20260806 13:01:34.349956 24926 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:34.350257 24926 heartbeater.cc:511] Master 127.20.245.190:46865 requested a full tablet report, sending...
I20260806 13:01:34.350857 24596 ts_manager.cc:194] Registered new tserver with Master: 9da9d4825a1745aa949dab0f99057d69 (127.20.245.130:42193)
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
I20260806 13:01:34.351442 24596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:36681
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:34.380782 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46865
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:34.505558 24931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:34.505946 24931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:34.505985 24931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:34.508081 24931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:34.508184 24931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:34.508229 24931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:34.510610 24931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:34.511106 24931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:34.511559 24931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:34.518877 24938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:34.518847 24937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:34.518847 24940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:34.519320 24931 server_base.cc:1034] running on GCE node
I20260806 13:01:34.519603 24931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:34.519953 24931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:34.521147 24931 hybrid_clock.cc:648] HybridClock initialized: now 1786021294521123 us; error 38 us; skew 500 ppm
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[24551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021294, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:34.525106 24931 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:34.525936 24931 webserver.cc:460] Webserver started at http://127.20.245.131:40925/ using document root <none> and password file <none>
I20260806 13:01:34.526337 24931 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:34.526408 24931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:34.526628 24931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:34.528265 24931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "9efa1a58b0bb4e799058927e14c2c3c7"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "940ba1b1a444ca8d6870567f5e4db87b"
server_key_iv: "5fa2c3c2e229785161c5d4e0813ed946"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.528779 24931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "9efa1a58b0bb4e799058927e14c2c3c7"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "940ba1b1a444ca8d6870567f5e4db87b"
server_key_iv: "5fa2c3c2e229785161c5d4e0813ed946"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.530706 24931 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:34.532061 24947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.532402 24931 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:34.532522 24931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "9efa1a58b0bb4e799058927e14c2c3c7"
format_stamp: "Formatted at 2026-08-06 13:01:34 on dist-test-slave-srgv"
server_key: "940ba1b1a444ca8d6870567f5e4db87b"
server_key_iv: "5fa2c3c2e229785161c5d4e0813ed946"
server_key_version: "encryptionkey@0"
I20260806 13:01:34.532609 24931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:34.543802 24931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:34.547421 24931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:34.547586 24931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:34.547892 24931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:34.548310 24931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:34.548352 24931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.548378 24931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:34.548391 24931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:34.556236 24931 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:41891
I20260806 13:01:34.556288 25061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:41891 every 8 connection(s)
I20260806 13:01:34.556833 24931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:34.560818 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 24931
I20260806 13:01:34.560926 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:34.561252 21462 external_mini_cluster.cc:1428] Setting key be218b9b8e6ee0a7425a7c5574679251
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[24551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021294, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:34.571249 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:34.557992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:59327 (local address 127.20.245.190:46865)
0806 13:01:34.558107 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:34.558110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:34.558473 (+ 363us) server_negotiation.cc:407] Connection header received
0806 13:01:34.559321 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:34.559323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:34.559343 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:34.559415 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:34.560787 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.561610 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.563204 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.563477 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.563587 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:34.566906 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:34.566910 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:34.566910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:34.566922 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:34.568947 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:34.569730 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:34.569733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:34.569733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:34.569831 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:34.570272 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:34.570273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:34.570274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:34.570470 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:34.570558 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:34.570954 (+ 396us) server_negotiation.cc:299] Negotiation successful
0806 13:01:34.571078 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 13:01:34.571520 25064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:34.557965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46865 (local address 127.20.245.131:59327)
0806 13:01:34.558287 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:34.558339 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:34.559090 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:34.559519 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:34.559524 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:34.560330 (+ 806us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:34.560633 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:34.560640 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.561753 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.561754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:34.563075 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:34.563078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.563606 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.563607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:34.563789 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:34.564522 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:34.564534 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:34.566684 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:34.569106 (+ 2422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:34.569125 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:34.569129 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:34.569546 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:34.569968 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:34.569970 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:34.569970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:34.570159 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:34.570555 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:34.570562 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:34.570752 (+ 190us) client_negotiation.cc:769] Sending connection context
0806 13:01:34.570868 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 13:01:34.571074 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":189,"threads_started":1}
I20260806 13:01:34.572278 25062 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46865
I20260806 13:01:34.572434 25062 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:34.572670 25062 heartbeater.cc:511] Master 127.20.245.190:46865 requested a full tablet report, sending...
I20260806 13:01:34.573496 24596 ts_manager.cc:194] Registered new tserver with Master: 9efa1a58b0bb4e799058927e14c2c3c7 (127.20.245.131:41891)
I20260806 13:01:34.574131 24596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:59327
I20260806 13:01:34.574597 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[24551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021294, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[24551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021294, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:34.608019 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:34.597942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60100 (local address 127.20.245.190:46865)
0806 13:01:34.598029 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:34.598032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:34.598167 (+ 135us) server_negotiation.cc:407] Connection header received
0806 13:01:34.598236 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:34.598238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:34.598254 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:34.598309 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:34.599144 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.599891 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.600995 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:34.601249 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:34.601326 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:34.604584 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:34.604587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:34.604587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:34.604600 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:34.606358 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:34.606761 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:34.606763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:34.606763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:34.606827 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:34.607164 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:34.607165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:34.607166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:34.607444 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:34.607547 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:34.607804 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 13:01:34.607927 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260806 13:01:34.608412 24595 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60100
I20260806 13:01:34.609021 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 24661
I20260806 13:01:34.616659 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 24796
I20260806 13:01:34.622797 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 24931
I20260806 13:01:34.629590 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 24564
2026-08-06T13:01:34Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2246 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[25075](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[25075](info): set up 2 sockets
Aug 06 13:01:34 dist-test-slave-srgv krb5kdc[25075](info): commencing operation
krb5kdc: starting...
W20260806 13:01:35.795529 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:35 dist-test-slave-srgv krb5kdc[25075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:35.955461 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:39495
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:32907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:39495
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:36.060789 25089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:36.061189 25089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:36.061240 25089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:36.063073 25089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:36.063184 25089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:36.063267 25089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:36.063324 25089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:36.063371 25089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:36.066152 25089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:32907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:39495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:39495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:36.066677 25089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:36.067034 25089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:36.074754 25094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:36.074759 25097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:36.074786 25089 server_base.cc:1034] running on GCE node
W20260806 13:01:36.074771 25095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:36.075553 25089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:36.076001 25089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:36.077316 25089 hybrid_clock.cc:648] HybridClock initialized: now 1786021296077287 us; error 43 us; skew 500 ppm
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:36.080921 25089 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:36.081650 25089 webserver.cc:460] Webserver started at http://127.20.245.190:33855/ using document root <none> and password file <none>
I20260806 13:01:36.081990 25089 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:36.082077 25089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:36.082391 25089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:36.084205 25089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "27a83d402e1547309269a62a3c09926d"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "a0add22655f371634741c1576b6ab92c"
server_key_iv: "3430ef56e779631c6f4e7cb02ff8b1cd"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.084753 25089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "27a83d402e1547309269a62a3c09926d"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "a0add22655f371634741c1576b6ab92c"
server_key_iv: "3430ef56e779631c6f4e7cb02ff8b1cd"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.087707 25089 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260806 13:01:36.089293 25104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.089696 25089 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:36.089835 25089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "27a83d402e1547309269a62a3c09926d"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "a0add22655f371634741c1576b6ab92c"
server_key_iv: "3430ef56e779631c6f4e7cb02ff8b1cd"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.089948 25089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:36.100216 25089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:36.104566 25089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:36.104745 25089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:36.111052 25089 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:39495
I20260806 13:01:36.111109 25157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:39495 every 8 connection(s)
I20260806 13:01:36.112008 25089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:36.113021 25158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:36.113698 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 25089
I20260806 13:01:36.113839 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:36.114082 21462 external_mini_cluster.cc:1428] Setting key 8a87f80c7fd95b496d6beb7d41409306
I20260806 13:01:36.117499 25158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d: Bootstrap starting.
I20260806 13:01:36.118598 25158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:36.119055 25158 log.cc:824] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:36.120326 25158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d: No bootstrap required, opened a new log
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:36.123535 25158 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a83d402e1547309269a62a3c09926d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39495 } }
I20260806 13:01:36.123875 25158 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:36.123939 25158 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27a83d402e1547309269a62a3c09926d, State: Initialized, Role: FOLLOWER
I20260806 13:01:36.124142 25158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a83d402e1547309269a62a3c09926d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39495 } }
I20260806 13:01:36.124228 25158 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:36.124258 25158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:36.124359 25158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:36.125902 25158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a83d402e1547309269a62a3c09926d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39495 } }
I20260806 13:01:36.126101 25158 leader_election.cc:302] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27a83d402e1547309269a62a3c09926d; no voters:
I20260806 13:01:36.126410 25158 leader_election.cc:288] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:36.126505 25163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:36.126694 25163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [term 1 LEADER]: Becoming Leader. State: Replica: 27a83d402e1547309269a62a3c09926d, State: Running, Role: LEADER
I20260806 13:01:36.126832 25163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a83d402e1547309269a62a3c09926d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39495 } }
I20260806 13:01:36.126880 25158 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:36.127321 25163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27a83d402e1547309269a62a3c09926d. Latest consensus state: current_term: 1 leader_uuid: "27a83d402e1547309269a62a3c09926d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a83d402e1547309269a62a3c09926d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39495 } } }
I20260806 13:01:36.127432 25163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:36.127338 25165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27a83d402e1547309269a62a3c09926d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a83d402e1547309269a62a3c09926d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39495 } } }
I20260806 13:01:36.127629 25165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:36.128665 25168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:36.129487 25168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:36.131399 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.114895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48178 (local address 127.20.245.190:39495)
0806 13:01:36.115245 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:36.115261 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:36.115305 (+ 44us) server_negotiation.cc:407] Connection header received
0806 13:01:36.115901 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:36.115911 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:36.115987 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:36.116162 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:36.117347 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.118489 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.119795 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.120364 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.120525 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.124714 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:36.124721 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:36.124722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:36.124742 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:36.127982 (+ 3240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.128641 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.128645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.128646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.128853 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.129474 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.129476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.129476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.130053 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:36.130426 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:36.130884 (+ 458us) server_negotiation.cc:299] Negotiation successful
0806 13:01:36.131134 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":113,"threads_started":1}
I20260806 13:01:36.131980 25168 catalog_manager.cc:1347] Generated new cluster ID: 0d21c34ce74a4254b5e9a4806383f571
I20260806 13:01:36.132045 25168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:36.138744 25168 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:36.139870 25168 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:36.151568 25168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27a83d402e1547309269a62a3c09926d: Generated new TSK 0
I20260806 13:01:36.151916 25168 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:36.192010 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39495
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:32907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:36.304382 25184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:36.304672 25184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:36.304703 25184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:36.306035 25184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:36.306079 25184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:36.306108 25184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:36.307961 25184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:32907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:36.308259 25184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:36.308502 25184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:01:36.314886 25184 server_base.cc:1034] running on GCE node
W20260806 13:01:36.314977 25189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:36.314991 25190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:36.315107 25192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:36.315506 25184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:36.315827 25184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:36.317001 25184 hybrid_clock.cc:648] HybridClock initialized: now 1786021296316952 us; error 71 us; skew 500 ppm
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:36.320971 25184 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:36.321676 25184 webserver.cc:460] Webserver started at http://127.20.245.129:42949/ using document root <none> and password file <none>
I20260806 13:01:36.321985 25184 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:36.322069 25184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:36.322254 25184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:36.323740 25184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "1242a4ef0b844ec89e628aba20f6ba4a"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "e61a4bd020b54a30d4ff47900ef75f15"
server_key_iv: "b7ba4474c29249d7b833fa522901f614"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.324203 25184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "1242a4ef0b844ec89e628aba20f6ba4a"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "e61a4bd020b54a30d4ff47900ef75f15"
server_key_iv: "b7ba4474c29249d7b833fa522901f614"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.326139 25184 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:36.327422 25199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.327862 25184 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:36.328011 25184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "1242a4ef0b844ec89e628aba20f6ba4a"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "e61a4bd020b54a30d4ff47900ef75f15"
server_key_iv: "b7ba4474c29249d7b833fa522901f614"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.328184 25184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:36.352445 25184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:36.355540 25184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:36.355829 25184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:36.356205 25184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:36.356685 25184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:36.356755 25184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.356812 25184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:36.356871 25184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.365479 25184 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:42893
I20260806 13:01:36.365528 25314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:42893 every 8 connection(s)
I20260806 13:01:36.366000 25184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:36.370644 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 25184
I20260806 13:01:36.370784 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:36.371013 21462 external_mini_cluster.cc:1428] Setting key cc3061fa0a9f601afed56dba24dd753f
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:36.381872 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.367611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:35467 (local address 127.20.245.190:39495)
0806 13:01:36.367676 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:36.367678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:36.367974 (+ 296us) server_negotiation.cc:407] Connection header received
0806 13:01:36.369167 (+ 1193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:36.369168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:36.369187 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:36.369268 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:36.370168 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.371022 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.372597 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.373031 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.373136 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.376637 (+ 3501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:36.376640 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:36.376641 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:36.376653 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:36.379120 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.380005 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.380007 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.380008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.380100 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.380767 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.380770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.380770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.380976 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:36.381061 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:36.381574 (+ 513us) server_negotiation.cc:299] Negotiation successful
0806 13:01:36.381722 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:01:36.382018 25317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.367540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39495 (local address 127.20.245.129:35467)
0806 13:01:36.367804 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:36.367856 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:36.369020 (+ 1164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:36.369370 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:36.369375 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:36.369769 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:36.370049 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:36.370053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.371210 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.371211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:36.372479 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:36.372483 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.373155 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.373156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:36.373368 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.374192 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:36.374208 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:36.376477 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:36.379363 (+ 2886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:36.379385 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:36.379389 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:36.379866 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:36.380443 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:36.380444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:36.380444 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:36.380642 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:36.381149 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:36.381160 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:36.381370 (+ 210us) client_negotiation.cc:769] Sending connection context
0806 13:01:36.381491 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 13:01:36.381715 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":138,"threads_started":1}
I20260806 13:01:36.382900 25315 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39495
I20260806 13:01:36.383245 25315 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:01:36.383564 25315 heartbeater.cc:511] Master 127.20.245.190:39495 requested a full tablet report, sending...
I20260806 13:01:36.384308 25121 ts_manager.cc:194] Registered new tserver with Master: 1242a4ef0b844ec89e628aba20f6ba4a (127.20.245.129:42893)
I20260806 13:01:36.385114 25121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:35467
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:36.409132 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39495
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:32907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:36.514802 25320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:36.515129 25320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:36.515162 25320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:36.516770 25320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:36.516841 25320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:36.516876 25320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:36.518714 25320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:32907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:36.519016 25320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:36.519354 25320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:36.526067 25328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:36.526132 25325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:36.526067 25326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:36.526661 25320 server_base.cc:1034] running on GCE node
I20260806 13:01:36.526993 25320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:36.527419 25320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:36.528656 25320 hybrid_clock.cc:648] HybridClock initialized: now 1786021296528641 us; error 38 us; skew 500 ppm
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:36.532243 25320 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:36.533016 25320 webserver.cc:460] Webserver started at http://127.20.245.130:35415/ using document root <none> and password file <none>
I20260806 13:01:36.533486 25320 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:36.533594 25320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:36.533851 25320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:36.535543 25320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "40d222ecee5144beaf21c346a6857416"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "f8ae337dcacf6e04a5b1c2aad504f364"
server_key_iv: "4c8fe81af8e972709f977afd4206fd00"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.536085 25320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "40d222ecee5144beaf21c346a6857416"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "f8ae337dcacf6e04a5b1c2aad504f364"
server_key_iv: "4c8fe81af8e972709f977afd4206fd00"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.538049 25320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:36.539348 25335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.539629 25320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:36.539858 25320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "40d222ecee5144beaf21c346a6857416"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "f8ae337dcacf6e04a5b1c2aad504f364"
server_key_iv: "4c8fe81af8e972709f977afd4206fd00"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.540040 25320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:36.556253 25320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:36.559684 25320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:36.559912 25320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:36.560261 25320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:36.560693 25320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:36.560752 25320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.560793 25320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:36.560840 25320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.568799 25320 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:45005
I20260806 13:01:36.568904 25450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:45005 every 8 connection(s)
I20260806 13:01:36.569378 25320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:36.579458 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 25320
I20260806 13:01:36.579648 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:36.579901 21462 external_mini_cluster.cc:1428] Setting key d2841957e0e5442e8f9be880ff2ed94e
I20260806 13:01:36.583459 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.570468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:55829 (local address 127.20.245.190:39495)
0806 13:01:36.570548 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:36.570551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:36.570775 (+ 224us) server_negotiation.cc:407] Connection header received
0806 13:01:36.572037 (+ 1262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:36.572039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:36.572056 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:36.572150 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:36.573296 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.573890 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.575522 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.575785 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.575892 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.579131 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:36.579133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:36.579134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:36.579144 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:36.581302 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.582018 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.582019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.582019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.582091 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.582432 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.582433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.582433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.582573 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:36.582634 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:36.583095 (+ 461us) server_negotiation.cc:299] Negotiation successful
0806 13:01:36.583289 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 13:01:36.583673 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.570396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39495 (local address 127.20.245.130:55829)
0806 13:01:36.570592 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:36.570645 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:36.571870 (+ 1225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:36.572380 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:36.572386 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:36.572803 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:36.573088 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:36.573094 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.574020 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.574021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:36.575076 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:36.575079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.575927 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.575928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:36.576081 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.576850 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:36.576863 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:36.578885 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:36.581410 (+ 2525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:36.581423 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:36.581427 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:36.581926 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:36.582165 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:36.582166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:36.582167 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:36.582362 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:36.582643 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:36.582650 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:36.582892 (+ 242us) client_negotiation.cc:769] Sending connection context
0806 13:01:36.583031 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 13:01:36.583368 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":112,"threads_started":1}
I20260806 13:01:36.584607 25451 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39495
I20260806 13:01:36.584767 25451 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:36.585022 25451 heartbeater.cc:511] Master 127.20.245.190:39495 requested a full tablet report, sending...
I20260806 13:01:36.585546 25121 ts_manager.cc:194] Registered new tserver with Master: 40d222ecee5144beaf21c346a6857416 (127.20.245.130:45005)
I20260806 13:01:36.586045 25121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:55829
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:36.616745 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39495
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:32907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:36.730217 25456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:36.730543 25456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:36.730582 25456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:36.732259 25456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:36.732319 25456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:36.732354 25456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:36.734618 25456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:32907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:36.734954 25456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:36.735291 25456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:36.742080 25461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:36.742074 25464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:36.742048 25462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:36.742398 25456 server_base.cc:1034] running on GCE node
I20260806 13:01:36.742715 25456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:36.743007 25456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:36.744230 25456 hybrid_clock.cc:648] HybridClock initialized: now 1786021296744213 us; error 37 us; skew 500 ppm
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:36.747905 25456 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:36.748795 25456 webserver.cc:460] Webserver started at http://127.20.245.131:42475/ using document root <none> and password file <none>
I20260806 13:01:36.749143 25456 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:36.749228 25456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:36.749430 25456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:36.750838 25456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "0c116af3d64644e59dc611984c6c459f"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "145cdd91ed7b350cd9626c0fd6607f77"
server_key_iv: "da4948eaa3e18166d563616b0902c0eb"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.751403 25456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "0c116af3d64644e59dc611984c6c459f"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "145cdd91ed7b350cd9626c0fd6607f77"
server_key_iv: "da4948eaa3e18166d563616b0902c0eb"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.753739 25456 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 13:01:36.754988 25471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.755298 25456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:36.755478 25456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "0c116af3d64644e59dc611984c6c459f"
format_stamp: "Formatted at 2026-08-06 13:01:36 on dist-test-slave-srgv"
server_key: "145cdd91ed7b350cd9626c0fd6607f77"
server_key_iv: "da4948eaa3e18166d563616b0902c0eb"
server_key_version: "encryptionkey@0"
I20260806 13:01:36.755609 25456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:36.772846 25456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:36.778187 25456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:36.778577 25456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:36.779314 25456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:36.779860 25456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:36.779927 25456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.779969 25456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:36.780001 25456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:36.788060 25456 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:36223
I20260806 13:01:36.788323 25586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:36223 every 8 connection(s)
I20260806 13:01:36.788661 25456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:36.795362 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 25456
I20260806 13:01:36.795545 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:36.795862 21462 external_mini_cluster.cc:1428] Setting key 3e76f7bbc7511f26f3484625fc4a555d
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:36.802318 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.789924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:44791 (local address 127.20.245.190:39495)
0806 13:01:36.790044 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:36.790046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:36.790436 (+ 390us) server_negotiation.cc:407] Connection header received
0806 13:01:36.791729 (+ 1293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:36.791731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:36.791748 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:36.791828 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:36.792873 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.793554 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.794903 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.795347 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.795439 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.798851 (+ 3412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:36.798854 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:36.798854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:36.798863 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:36.800612 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.801119 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.801121 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.801121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.801199 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.801477 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.801478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.801478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.801633 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:36.801696 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:36.802142 (+ 446us) server_negotiation.cc:299] Negotiation successful
0806 13:01:36.802235 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 13:01:36.802412 25589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.789888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39495 (local address 127.20.245.131:44791)
0806 13:01:36.790217 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:36.790274 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:36.791570 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:36.791972 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:36.791977 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:36.792403 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:36.792725 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:36.792732 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.793720 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.793721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:36.794792 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:36.794795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.795521 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.795523 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:36.795784 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.796718 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:36.796750 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:36.798733 (+ 1983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:36.800723 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:36.800731 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:36.800734 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:36.801012 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:36.801287 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:36.801288 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:36.801288 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:36.801411 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:36.801695 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:36.801701 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:36.801872 (+ 171us) client_negotiation.cc:769] Sending connection context
0806 13:01:36.801974 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 13:01:36.802143 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":126,"threads_started":1}
I20260806 13:01:36.803041 25587 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39495
I20260806 13:01:36.803249 25587 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:36.803504 25587 heartbeater.cc:511] Master 127.20.245.190:39495 requested a full tablet report, sending...
I20260806 13:01:36.804127 25121 ts_manager.cc:194] Registered new tserver with Master: 0c116af3d64644e59dc611984c6c459f (127.20.245.131:36223)
I20260806 13:01:36.804553 25121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:44791
I20260806 13:01:36.808840 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:36.839479 25594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.828715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51870 (local address 127.20.245.129:42893)
0806 13:01:36.828863 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:36.828871 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:36.828887 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:01:36.828934 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:36.828936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:36.828955 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:36.829044 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:36.829731 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.830558 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.831531 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.832062 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.832213 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.835471 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:36.835496 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:36.835496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:36.835508 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:36.837646 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.838250 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.838255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.838256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.838331 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.838639 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.838641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.838641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.838875 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:36.839026 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:36.839133 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 13:01:36.839365 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:36.851478 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:36.841561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48186 (local address 127.20.245.190:39495)
0806 13:01:36.841671 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:36.841674 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:36.841738 (+ 64us) server_negotiation.cc:407] Connection header received
0806 13:01:36.841828 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:36.841831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:36.841849 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:36.841920 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:36.842550 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.843123 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.844027 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:36.844412 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:36.844527 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:36.847749 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:36.847752 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:36.847753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:36.847765 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:36.849779 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.850315 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.850317 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.850317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.850398 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:36.850631 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:36.850632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:36.850633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:36.850861 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:36.850996 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:36.851165 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 13:01:36.851330 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 13:01:36.851961 25121 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48186
I20260806 13:01:36.852471 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 25184
I20260806 13:01:36.859596 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 25320
I20260806 13:01:36.866168 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 25456
I20260806 13:01:36.872805 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 25089
2026-08-06T13:01:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2242 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25599](info): set up 2 sockets
Aug 06 13:01:36 dist-test-slave-srgv krb5kdc[25599](info): commencing operation
krb5kdc: starting...
W20260806 13:01:38.004220 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:38.167279 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:37115
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:37115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:38.272449 25612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:38.272845 25612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:38.272895 25612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:38.274655 25612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:38.274752 25612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:38.274777 25612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:38.274801 25612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:38.274830 25612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:38.277009 25612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:37115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:37115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:38.277454 25612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:38.277768 25612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:38.284375 25617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:38.284411 25618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:38.284412 25620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:38.284811 25612 server_base.cc:1034] running on GCE node
I20260806 13:01:38.285166 25612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:38.285645 25612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:38.286866 25612 hybrid_clock.cc:648] HybridClock initialized: now 1786021298286834 us; error 53 us; skew 500 ppm
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:38.297775 25612 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:38.298408 25612 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:38.298506 25612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:38.298729 25612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:38.300359 25612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "cbf6e93be6c547e586ed547b600f8c8f"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "bcfeeccf3b13a4b34d8c5c8f221d8d1e"
server_key_iv: "dd3488c4f1a764d1a7cbc356501a122b"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.300843 25612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "cbf6e93be6c547e586ed547b600f8c8f"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "bcfeeccf3b13a4b34d8c5c8f221d8d1e"
server_key_iv: "dd3488c4f1a764d1a7cbc356501a122b"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.302577 25612 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 13:01:38.303740 25626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.303962 25612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:38.304091 25612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "cbf6e93be6c547e586ed547b600f8c8f"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "bcfeeccf3b13a4b34d8c5c8f221d8d1e"
server_key_iv: "dd3488c4f1a764d1a7cbc356501a122b"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.304193 25612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:38.321233 25612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:38.324786 25612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:38.325062 25612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:38.330746 25612 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:37115
I20260806 13:01:38.330772 25678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:37115 every 8 connection(s)
I20260806 13:01:38.331364 25612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:38.332827 25679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:38.335522 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 25612
I20260806 13:01:38.335754 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:38.336035 21462 external_mini_cluster.cc:1428] Setting key 96d4c6e511398e9967a676a50837a734
I20260806 13:01:38.336573 25679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f: Bootstrap starting.
I20260806 13:01:38.337576 25679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:38.337977 25679 log.cc:824] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:38.339074 25679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f: No bootstrap required, opened a new log
I20260806 13:01:38.341591 25679 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbf6e93be6c547e586ed547b600f8c8f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37115 } }
I20260806 13:01:38.341871 25679 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:38.341926 25679 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf6e93be6c547e586ed547b600f8c8f, State: Initialized, Role: FOLLOWER
I20260806 13:01:38.342154 25679 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbf6e93be6c547e586ed547b600f8c8f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37115 } }
I20260806 13:01:38.342268 25679 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:38.342316 25679 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:38.342373 25679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:38.343406 25679 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbf6e93be6c547e586ed547b600f8c8f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37115 } }
I20260806 13:01:38.343570 25679 leader_election.cc:302] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbf6e93be6c547e586ed547b600f8c8f; no voters:
I20260806 13:01:38.343873 25679 leader_election.cc:288] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:38.343961 25684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:38.344172 25684 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [term 1 LEADER]: Becoming Leader. State: Replica: cbf6e93be6c547e586ed547b600f8c8f, State: Running, Role: LEADER
I20260806 13:01:38.344300 25679 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:38.344314 25684 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbf6e93be6c547e586ed547b600f8c8f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37115 } }
I20260806 13:01:38.344949 25685 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbf6e93be6c547e586ed547b600f8c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbf6e93be6c547e586ed547b600f8c8f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37115 } } }
I20260806 13:01:38.344965 25686 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbf6e93be6c547e586ed547b600f8c8f. Latest consensus state: current_term: 1 leader_uuid: "cbf6e93be6c547e586ed547b600f8c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbf6e93be6c547e586ed547b600f8c8f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37115 } } }
I20260806 13:01:38.345198 25685 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:38.345213 25686 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f [sys.catalog]: This master's current role is: LEADER
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:38.346192 25693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:38.347000 25693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:38.349332 25693 catalog_manager.cc:1347] Generated new cluster ID: a34a7ecaaa3f41edbf4cf08bcf1e0c2c
I20260806 13:01:38.349488 25693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:38.351328 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:38.336848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54442 (local address 127.20.245.190:37115)
0806 13:01:38.337101 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:38.337112 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:38.337147 (+ 35us) server_negotiation.cc:407] Connection header received
0806 13:01:38.337894 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:38.337905 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:38.337992 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:38.338211 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:38.339288 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.340453 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.341699 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.342474 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.342597 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:38.346523 (+ 3926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:38.346529 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:38.346529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:38.346544 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:38.348976 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:38.349525 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:38.349530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:38.349531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:38.349676 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:38.349981 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:38.349982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:38.349982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:38.350460 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:38.350664 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:38.350780 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 13:01:38.350988 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":131,"threads_started":1}
I20260806 13:01:38.359666 25693 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:38.360323 25693 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:38.366295 25693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f: Generated new TSK 0
I20260806 13:01:38.366581 25693 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:38.400236 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37115
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:38.522329 25706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:38.522655 25706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:38.522687 25706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:38.524258 25706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:38.524323 25706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:38.524359 25706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:38.526351 25706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:38.526750 25706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:38.527079 25706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:38.534217 25714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:38.534204 25711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:38.534209 25712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:38.535413 25706 server_base.cc:1034] running on GCE node
I20260806 13:01:38.535780 25706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:38.536170 25706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:38.537379 25706 hybrid_clock.cc:648] HybridClock initialized: now 1786021298537347 us; error 54 us; skew 500 ppm
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:38.541613 25706 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:38.542099 25706 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:38.542168 25706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:38.542305 25706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:38.543937 25706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "c8027e71b3c24d62a5daeef473e3c26f"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "a773b497f4760ad5f3ebf022c54ab285"
server_key_iv: "b3e81f110053a812f7ffdf36fdfdd8d4"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.544555 25706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "c8027e71b3c24d62a5daeef473e3c26f"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "a773b497f4760ad5f3ebf022c54ab285"
server_key_iv: "b3e81f110053a812f7ffdf36fdfdd8d4"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.546625 25706 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:38.547724 25720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.548040 25706 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:38.548134 25706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "c8027e71b3c24d62a5daeef473e3c26f"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "a773b497f4760ad5f3ebf022c54ab285"
server_key_iv: "b3e81f110053a812f7ffdf36fdfdd8d4"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.548204 25706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:38.568774 25706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:38.571538 25706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:38.571703 25706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:38.571988 25706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:38.572429 25706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:38.572470 25706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.572508 25706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:38.572559 25706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.580476 25706 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:37047
I20260806 13:01:38.580513 25836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:37047 every 8 connection(s)
I20260806 13:01:38.581142 25706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:38.588833 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 25706
I20260806 13:01:38.588999 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:38.589277 21462 external_mini_cluster.cc:1428] Setting key 8d599ebdde5c20ffd9c1da08ef6098af
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:38.594758 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:38.582339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:34673 (local address 127.20.245.190:37115)
0806 13:01:38.582464 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:38.582467 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:38.582678 (+ 211us) server_negotiation.cc:407] Connection header received
0806 13:01:38.583479 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:38.583481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:38.583499 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:38.583558 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:38.584827 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.585460 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.586683 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.586922 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.587013 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:38.590329 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:38.590332 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:38.590332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:38.590343 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:38.592479 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:38.593254 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:38.593256 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:38.593256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:38.593333 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:38.593789 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:38.593790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:38.593791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:38.593974 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:38.594049 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:38.594534 (+ 485us) server_negotiation.cc:299] Negotiation successful
0806 13:01:38.594664 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 13:01:38.595089 25839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:38.582237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:37115 (local address 127.20.245.129:34673)
0806 13:01:38.582508 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:38.582569 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:38.583338 (+ 769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:38.583660 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:38.583666 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:38.584030 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:38.584672 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:38.584679 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.585598 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.585600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:38.586555 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:38.586558 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.587026 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.587027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:38.587261 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:38.587993 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:38.588005 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:38.590132 (+ 2127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:38.592620 (+ 2488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:38.592636 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:38.592640 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:38.593122 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:38.593423 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:38.593424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:38.593424 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:38.593661 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:38.594072 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:38.594080 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:38.594328 (+ 248us) client_negotiation.cc:769] Sending connection context
0806 13:01:38.594477 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 13:01:38.594723 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":109,"threads_started":1}
I20260806 13:01:38.596102 25837 heartbeater.cc:347] Connected to a master server at 127.20.245.190:37115
I20260806 13:01:38.596302 25837 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:38.596570 25837 heartbeater.cc:511] Master 127.20.245.190:37115 requested a full tablet report, sending...
I20260806 13:01:38.597345 25643 ts_manager.cc:194] Registered new tserver with Master: c8027e71b3c24d62a5daeef473e3c26f (127.20.245.129:37047)
I20260806 13:01:38.598245 25643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:34673
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:38.626441 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37115
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:38.725760 25842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:38.726092 25842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:38.726140 25842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:38.727494 25842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:38.727577 25842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:38.727625 25842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:38.729543 25842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:38.729923 25842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:38.730237 25842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:38.736491 25847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:38.736478 25848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:38.736506 25842 server_base.cc:1034] running on GCE node
W20260806 13:01:38.736482 25850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:38.737030 25842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:38.737383 25842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:38.738603 25842 hybrid_clock.cc:648] HybridClock initialized: now 1786021298738579 us; error 44 us; skew 500 ppm
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:38.742550 25842 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:38.743067 25842 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:38.743155 25842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:38.743393 25842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:38.744915 25842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "1e9cf093b1ae411bab0f5fe251397849"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "c42382e031b3504df52bfb91089c6d29"
server_key_iv: "d985148ea37523ce5da9adabb8d8b48a"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.745357 25842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "1e9cf093b1ae411bab0f5fe251397849"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "c42382e031b3504df52bfb91089c6d29"
server_key_iv: "d985148ea37523ce5da9adabb8d8b48a"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.747051 25842 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260806 13:01:38.748075 25857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.748389 25842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:38.748478 25842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "1e9cf093b1ae411bab0f5fe251397849"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "c42382e031b3504df52bfb91089c6d29"
server_key_iv: "d985148ea37523ce5da9adabb8d8b48a"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.748544 25842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:38.770143 25842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:38.773284 25842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:38.773442 25842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:38.773705 25842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:38.774124 25842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:38.774165 25842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.774199 25842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:38.774212 25842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.781876 25842 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:37409
I20260806 13:01:38.781962 25972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:37409 every 8 connection(s)
I20260806 13:01:38.782300 25842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:38.784260 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 25842
I20260806 13:01:38.784412 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:38.784636 21462 external_mini_cluster.cc:1428] Setting key ee09a8ca1b997a67df01d1bb22b64703
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
I20260806 13:01:38.796317 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:38.783444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:46517 (local address 127.20.245.190:37115)
0806 13:01:38.783544 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:38.783547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:38.783842 (+ 295us) server_negotiation.cc:407] Connection header received
0806 13:01:38.784668 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:38.784671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:38.784693 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:38.784754 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:38.786202 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.786823 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.788210 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.788449 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.788565 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:38.791846 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:38.791850 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:38.791850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:38.791866 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:38.794045 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:38.794676 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:38.794678 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:38.794679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:38.794759 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:38.795157 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:38.795158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:38.795159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:38.795409 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:38.795505 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:38.796053 (+ 548us) server_negotiation.cc:299] Negotiation successful
0806 13:01:38.796188 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 13:01:38.796622 25975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:38.783460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:37115 (local address 127.20.245.130:46517)
0806 13:01:38.783673 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:38.783719 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:38.784502 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:38.784854 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:38.784859 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:38.785317 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:38.786057 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:38.786065 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.786959 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.786960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:38.788034 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:38.788037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.788577 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.788578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:38.788744 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:38.789489 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:38.789501 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:38.791687 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:38.794193 (+ 2506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:38.794208 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:38.794212 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:38.794570 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:38.794890 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:38.794891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:38.794892 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:38.795068 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:38.795515 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:38.795527 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:38.795823 (+ 296us) client_negotiation.cc:769] Sending connection context
0806 13:01:38.796018 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 13:01:38.796279 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":113,"threads_started":1}
I20260806 13:01:38.797461 25973 heartbeater.cc:347] Connected to a master server at 127.20.245.190:37115
I20260806 13:01:38.797657 25973 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:38.797891 25973 heartbeater.cc:511] Master 127.20.245.190:37115 requested a full tablet report, sending...
I20260806 13:01:38.798467 25643 ts_manager.cc:194] Registered new tserver with Master: 1e9cf093b1ae411bab0f5fe251397849 (127.20.245.130:37409)
I20260806 13:01:38.798964 25643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:46517
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:38.823140 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37115
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:38.931278 25978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:38.931586 25978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:38.931618 25978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:38.933197 25978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:38.933259 25978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:38.933295 25978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:38.935431 25978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:38.935842 25978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:38.936180 25978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:38.942977 25984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:38.942987 25983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:38.942987 25986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:38.943070 25978 server_base.cc:1034] running on GCE node
I20260806 13:01:38.943572 25978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:38.943912 25978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:38.945133 25978 hybrid_clock.cc:648] HybridClock initialized: now 1786021298945079 us; error 66 us; skew 500 ppm
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:38.948695 25978 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:38.949149 25978 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:38.949204 25978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:38.949332 25978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:38.950714 25978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "1b2dc8f403f64c859866eef4d93dcff4"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "fcedcab4c1e85b033ea72af7238db0fa"
server_key_iv: "b3be9aa8e44bafacb86fb852ec937b48"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.951133 25978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "1b2dc8f403f64c859866eef4d93dcff4"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "fcedcab4c1e85b033ea72af7238db0fa"
server_key_iv: "b3be9aa8e44bafacb86fb852ec937b48"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.953456 25978 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260806 13:01:38.954515 25992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.954794 25978 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:38.954910 25978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "1b2dc8f403f64c859866eef4d93dcff4"
format_stamp: "Formatted at 2026-08-06 13:01:38 on dist-test-slave-srgv"
server_key: "fcedcab4c1e85b033ea72af7238db0fa"
server_key_iv: "b3be9aa8e44bafacb86fb852ec937b48"
server_key_version: "encryptionkey@0"
I20260806 13:01:38.954996 25978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:38.965927 25978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:38.968964 25978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:38.969129 25978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:38.969409 25978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:38.969882 25978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:38.969933 25978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.969964 25978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:38.969977 25978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:38.978379 25978 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:43065
I20260806 13:01:38.978474 26107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:43065 every 8 connection(s)
I20260806 13:01:38.978824 25978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:38.981199 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 25978
I20260806 13:01:38.981302 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:38.981606 21462 external_mini_cluster.cc:1428] Setting key d6c7e09eebc27129148d00dd09a79ad0
Aug 06 13:01:38 dist-test-slave-srgv krb5kdc[25599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021298, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:38.992385 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:38.979968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:56447 (local address 127.20.245.190:37115)
0806 13:01:38.980077 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:38.980080 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:38.980369 (+ 289us) server_negotiation.cc:407] Connection header received
0806 13:01:38.981056 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:38.981057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:38.981074 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:38.981143 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:38.982510 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.983139 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.984590 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.984845 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.984956 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:38.988656 (+ 3700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:38.988659 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:38.988660 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:38.988674 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:38.990420 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:38.990995 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:38.990997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:38.990998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:38.991070 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:38.991481 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:38.991483 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:38.991483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:38.991679 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:38.991782 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:38.992154 (+ 372us) server_negotiation.cc:299] Negotiation successful
0806 13:01:38.992263 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 13:01:38.992689 26110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:38.979910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:37115 (local address 127.20.245.131:56447)
0806 13:01:38.980197 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:38.980247 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:38.980924 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:38.981251 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:38.981256 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:38.981712 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:38.982390 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:38.982398 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.983347 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.983349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:38.984417 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:38.984420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:38.984974 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:38.984975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:38.985253 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:38.986057 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:38.986069 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:38.988478 (+ 2409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:38.990547 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:38.990563 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:38.990567 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:38.990900 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:38.991152 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:38.991153 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:38.991153 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:38.991358 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:38.991773 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:38.991782 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:38.991980 (+ 198us) client_negotiation.cc:769] Sending connection context
0806 13:01:38.992108 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 13:01:38.992337 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":114,"threads_started":1}
I20260806 13:01:38.993566 26108 heartbeater.cc:347] Connected to a master server at 127.20.245.190:37115
I20260806 13:01:38.993731 26108 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:38.993991 26108 heartbeater.cc:511] Master 127.20.245.190:37115 requested a full tablet report, sending...
I20260806 13:01:38.994479 25643 ts_manager.cc:194] Registered new tserver with Master: 1b2dc8f403f64c859866eef4d93dcff4 (127.20.245.131:43065)
I20260806 13:01:38.994959 25643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:56447
I20260806 13:01:39.005975 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:01:39.016819 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.007903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54458 (local address 127.20.245.190:37115)
0806 13:01:39.008022 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.008025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.008176 (+ 151us) server_negotiation.cc:407] Connection header received
0806 13:01:39.008212 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.008213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.008226 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.008286 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.009247 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.010092 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.011054 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.011451 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.011533 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.013247 (+ 1714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.013249 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.013249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:39.013258 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.015008 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:39.015595 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:39.015597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:39.015598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:39.015687 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:39.015995 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:39.015997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:39.015997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:39.016325 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.016443 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.016612 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.016722 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 13:01:39.019749 25643 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54458:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:39.022034 25643 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:39.030613 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.025759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58792 (local address 127.20.245.131:43065)
0806 13:01:39.026172 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.026178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.026191 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:01:39.026243 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.026246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.026266 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.026360 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:39.026799 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.027648 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.029293 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.030025 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.030151 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.030236 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.030441 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.030499 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":142,"threads_started":1}
I20260806 13:01:39.030638 26119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.025495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:37409 (local address 127.0.0.1:50624)
0806 13:01:39.025751 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.025807 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.025905 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.026485 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.026489 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.026492 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:39.026617 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.026621 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.028237 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.028238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.029338 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.029341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.030319 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.030321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.030392 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.030397 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.030431 (+ 34us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.030488 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":56,"thread_start_us":134,"threads_started":1}
I20260806 13:01:39.030640 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.025501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:43065 (local address 127.0.0.1:58792)
0806 13:01:39.026025 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.026039 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.026109 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.026489 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.026490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.026495 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:39.026738 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.026739 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.027769 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.027771 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.029174 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.029177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.030147 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.030148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.030258 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.030279 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.030364 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.030455 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":2,"thread_start_us":107,"threads_started":1}
I20260806 13:01:39.030779 26121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.025495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:37047 (local address 127.0.0.1:37148)
0806 13:01:39.026073 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.026083 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.026135 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.026482 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.026487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.026490 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:39.026674 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.026675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.028408 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.028409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.029390 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.029393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.030307 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.030308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.030383 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.030387 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.030440 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.030475 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":139,"thread_start_us":125,"threads_started":1}
I20260806 13:01:39.031086 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.025910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37148 (local address 127.20.245.129:37047)
0806 13:01:39.026270 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.026274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.026285 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:39.026332 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.026335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.026351 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.026531 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:39.026770 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.028101 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.029495 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.030238 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.030314 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.030368 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.030900 (+ 532us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.030961 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":98,"threads_started":1}
I20260806 13:01:39.031582 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.025911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50624 (local address 127.20.245.130:37409)
0806 13:01:39.026275 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.026280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.026293 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:01:39.026340 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.026343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.026361 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.026535 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:39.026684 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.028092 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.029426 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.030199 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.031014 (+ 815us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.031088 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.031115 (+ 27us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.031167 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":140,"threads_started":1}
I20260806 13:01:39.032128 25770 tablet_service.cc:1467] Processing CreateTablet for tablet 2a78607051504233bfa23d9990666a38 (DEFAULT_TABLE table=test-table [id=ff2ec4017a194e25835a062d6185b1ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:39.032160 26041 tablet_service.cc:1467] Processing CreateTablet for tablet 2a78607051504233bfa23d9990666a38 (DEFAULT_TABLE table=test-table [id=ff2ec4017a194e25835a062d6185b1ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:39.032285 25906 tablet_service.cc:1467] Processing CreateTablet for tablet 2a78607051504233bfa23d9990666a38 (DEFAULT_TABLE table=test-table [id=ff2ec4017a194e25835a062d6185b1ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:39.032615 25770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a78607051504233bfa23d9990666a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:39.032622 26041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a78607051504233bfa23d9990666a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:39.032655 25906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a78607051504233bfa23d9990666a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:39.037103 26126 tablet_bootstrap.cc:492] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f: Bootstrap starting.
I20260806 13:01:39.037720 26127 tablet_bootstrap.cc:492] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849: Bootstrap starting.
I20260806 13:01:39.038061 26126 tablet_bootstrap.cc:654] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:39.038491 26127 tablet_bootstrap.cc:654] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:39.038810 26126 log.cc:824] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:39.039264 26127 log.cc:824] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:39.039446 26128 tablet_bootstrap.cc:492] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: Bootstrap starting.
I20260806 13:01:39.040267 26128 tablet_bootstrap.cc:654] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:39.040334 26127 tablet_bootstrap.cc:492] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849: No bootstrap required, opened a new log
I20260806 13:01:39.040441 26127 ts_tablet_manager.cc:1397] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 13:01:39.040944 26128 log.cc:824] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:39.042064 26128 tablet_bootstrap.cc:492] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: No bootstrap required, opened a new log
I20260806 13:01:39.042259 26128 ts_tablet_manager.cc:1397] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:01:39.042629 26127 raft_consensus.cc:348] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.042836 26127 raft_consensus.cc:374] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:39.042865 26127 raft_consensus.cc:729] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9cf093b1ae411bab0f5fe251397849, State: Initialized, Role: FOLLOWER
I20260806 13:01:39.043087 26127 consensus_queue.cc:260] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.043603 26127 ts_tablet_manager.cc:1428] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260806 13:01:39.043609 25973 heartbeater.cc:503] Master 127.20.245.190:37115 was elected leader, sending a full tablet report...
I20260806 13:01:39.044029 26126 tablet_bootstrap.cc:492] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f: No bootstrap required, opened a new log
I20260806 13:01:39.044126 26126 ts_tablet_manager.cc:1397] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260806 13:01:39.045573 26128 raft_consensus.cc:348] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.045799 26128 raft_consensus.cc:374] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:39.045843 26128 raft_consensus.cc:729] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2dc8f403f64c859866eef4d93dcff4, State: Initialized, Role: FOLLOWER
I20260806 13:01:39.045979 26128 consensus_queue.cc:260] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.046432 26128 ts_tablet_manager.cc:1428] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 13:01:39.046438 26108 heartbeater.cc:503] Master 127.20.245.190:37115 was elected leader, sending a full tablet report...
I20260806 13:01:39.046916 26126 raft_consensus.cc:348] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.047137 26126 raft_consensus.cc:374] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:39.047257 26126 raft_consensus.cc:729] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8027e71b3c24d62a5daeef473e3c26f, State: Initialized, Role: FOLLOWER
I20260806 13:01:39.047418 26126 consensus_queue.cc:260] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.047832 26126 ts_tablet_manager.cc:1428] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260806 13:01:39.047827 25837 heartbeater.cc:503] Master 127.20.245.190:37115 was elected leader, sending a full tablet report...
W20260806 13:01:39.082162 25838 tablet.cc:2369] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:39.106828 26132 raft_consensus.cc:482] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:39.107030 26132 raft_consensus.cc:504] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.107723 26132 leader_election.cc:288] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8027e71b3c24d62a5daeef473e3c26f (127.20.245.129:37047), 1b2dc8f403f64c859866eef4d93dcff4 (127.20.245.131:43065)
I20260806 13:01:39.111016 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.108085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:40037 (local address 127.20.245.131:43065)
0806 13:01:39.108152 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.108154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.108171 (+ 17us) server_negotiation.cc:407] Connection header received
0806 13:01:39.108277 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.108278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.108289 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.108372 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:39.108569 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.109219 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.110230 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.110635 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.110721 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.110732 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.110892 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.110935 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 13:01:39.111019 25975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.107970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:43065 (local address 127.20.245.130:40037)
0806 13:01:39.108046 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.108061 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.108191 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.108379 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.108381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.108383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:39.108491 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.108493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.109307 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.109308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.110121 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.110123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.110720 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.110721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.110812 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.110816 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.110886 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.110930 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 13:01:39.111027 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.108141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:55153 (local address 127.20.245.129:37047)
0806 13:01:39.108196 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.108198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.108436 (+ 238us) server_negotiation.cc:407] Connection header received
0806 13:01:39.108506 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.108507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.108517 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.108572 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:39.108770 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.109286 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.110252 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.110650 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.110737 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.110746 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.110906 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.110951 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:01:39.111035 26135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.107983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:37047 (local address 127.20.245.130:55153)
0806 13:01:39.108343 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.108354 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.108433 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.108585 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.108586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.108588 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:39.108673 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.108675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.109375 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.109377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.110144 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:39.110146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.110736 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.110737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:39.110825 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.110829 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.110898 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.110938 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":104,"thread_start_us":199,"threads_started":1}
I20260806 13:01:39.111479 25790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a78607051504233bfa23d9990666a38" candidate_uuid: "1e9cf093b1ae411bab0f5fe251397849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8027e71b3c24d62a5daeef473e3c26f" is_pre_election: true
I20260806 13:01:39.111478 26061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a78607051504233bfa23d9990666a38" candidate_uuid: "1e9cf093b1ae411bab0f5fe251397849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2dc8f403f64c859866eef4d93dcff4" is_pre_election: true
I20260806 13:01:39.111693 26061 raft_consensus.cc:2454] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9cf093b1ae411bab0f5fe251397849 in term 0.
I20260806 13:01:39.111693 25790 raft_consensus.cc:2454] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9cf093b1ae411bab0f5fe251397849 in term 0.
I20260806 13:01:39.111972 25859 leader_election.cc:302] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2dc8f403f64c859866eef4d93dcff4, 1e9cf093b1ae411bab0f5fe251397849; no voters:
I20260806 13:01:39.112221 26132 raft_consensus.cc:2781] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:39.112289 26132 raft_consensus.cc:482] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:39.112319 26132 raft_consensus.cc:3037] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:39.113178 26132 raft_consensus.cc:504] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.113354 26132 leader_election.cc:288] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [CANDIDATE]: Term 1 election: Requested vote from peers c8027e71b3c24d62a5daeef473e3c26f (127.20.245.129:37047), 1b2dc8f403f64c859866eef4d93dcff4 (127.20.245.131:43065)
I20260806 13:01:39.113605 26061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a78607051504233bfa23d9990666a38" candidate_uuid: "1e9cf093b1ae411bab0f5fe251397849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2dc8f403f64c859866eef4d93dcff4"
I20260806 13:01:39.113616 25790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a78607051504233bfa23d9990666a38" candidate_uuid: "1e9cf093b1ae411bab0f5fe251397849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8027e71b3c24d62a5daeef473e3c26f"
I20260806 13:01:39.113730 26061 raft_consensus.cc:3037] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:39.113725 25790 raft_consensus.cc:3037] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:39.114640 25790 raft_consensus.cc:2454] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9cf093b1ae411bab0f5fe251397849 in term 1.
I20260806 13:01:39.114746 26061 raft_consensus.cc:2454] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9cf093b1ae411bab0f5fe251397849 in term 1.
I20260806 13:01:39.114840 25858 leader_election.cc:302] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9cf093b1ae411bab0f5fe251397849, c8027e71b3c24d62a5daeef473e3c26f; no voters:
I20260806 13:01:39.114938 26132 raft_consensus.cc:2781] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:39.115135 26132 raft_consensus.cc:686] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9cf093b1ae411bab0f5fe251397849, State: Running, Role: LEADER
I20260806 13:01:39.115288 26132 consensus_queue.cc:237] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } }
I20260806 13:01:39.116395 25643 catalog_manager.cc:5495] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9cf093b1ae411bab0f5fe251397849 (127.20.245.130). New cstate: current_term: 1 leader_uuid: "1e9cf093b1ae411bab0f5fe251397849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e9cf093b1ae411bab0f5fe251397849" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:39.129742 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.126539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50628 (local address 127.20.245.130:37409)
0806 13:01:39.126594 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.126596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.126612 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:01:39.126712 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.126712 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.126736 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.126806 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:39.126990 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.127792 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.128721 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:39.128936 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:39.129012 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:39.129292 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:39.129429 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:39.129501 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.129534 (+ 33us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.129557 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 13:01:39.132529 26061 raft_consensus.cc:1261] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 1 FOLLOWER]: Refusing update from remote peer 1e9cf093b1ae411bab0f5fe251397849: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:39.132561 25790 raft_consensus.cc:1261] T 2a78607051504233bfa23d9990666a38 P c8027e71b3c24d62a5daeef473e3c26f [term 1 FOLLOWER]: Refusing update from remote peer 1e9cf093b1ae411bab0f5fe251397849: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:39.133029 26132 consensus_queue.cc:1035] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8027e71b3c24d62a5daeef473e3c26f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:39.133224 26136 consensus_queue.cc:1035] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2dc8f403f64c859866eef4d93dcff4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:39.137084 26141 mvcc.cc:205] Tried to move back new op lower bound from 7315543241242677248 to 7315543241177006080. Current Snapshot: MvccSnapshot[applied={T|T < 7315543241242677248}]
I20260806 13:01:39.140419 25642 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:39.140573 25642 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:39.141662 25642 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cbf6e93be6c547e586ed547b600f8c8f: Sending DeleteTablet for 3 replicas of tablet 2a78607051504233bfa23d9990666a38
I20260806 13:01:39.142145 26041 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a78607051504233bfa23d9990666a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:39 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:58792
I20260806 13:01:39.142165 25770 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a78607051504233bfa23d9990666a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:39 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:37148
I20260806 13:01:39.142457 26150 tablet_replica.cc:330] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: stopping tablet replica
I20260806 13:01:39.142472 25906 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a78607051504233bfa23d9990666a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:39 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:50624
I20260806 13:01:39.142592 26150 raft_consensus.cc:2229] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:39.142727 26150 raft_consensus.cc:2258] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:39.142984 26151 tablet_replica.cc:330] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849: stopping tablet replica
I20260806 13:01:39.143105 26151 raft_consensus.cc:2229] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:39.143293 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 25706
I20260806 13:01:39.144163 26150 ts_tablet_manager.cc:1905] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:39.144596 26151 raft_consensus.cc:2258] T 2a78607051504233bfa23d9990666a38 P 1e9cf093b1ae411bab0f5fe251397849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:39.146581 26150 ts_tablet_manager.cc:1918] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:39.146677 26150 log.cc:1196] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/2a78607051504233bfa23d9990666a38
I20260806 13:01:39.147006 26150 ts_tablet_manager.cc:1939] T 2a78607051504233bfa23d9990666a38 P 1b2dc8f403f64c859866eef4d93dcff4: Deleting consensus metadata
I20260806 13:01:39.147708 25628 catalog_manager.cc:4841] TS 1b2dc8f403f64c859866eef4d93dcff4 (127.20.245.131:43065): tablet 2a78607051504233bfa23d9990666a38 (table test-table [id=ff2ec4017a194e25835a062d6185b1ba]) successfully deleted
W20260806 13:01:39.150416 25627 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:37047 (error 108)
I20260806 13:01:39.151265 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.150994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:37047 (local address 127.0.0.1:37164)
0806 13:01:39.151118 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.151217 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:37047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 13:01:39.151589 25627 catalog_manager.cc:4584] TS c8027e71b3c24d62a5daeef473e3c26f (127.20.245.129:37047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2a78607051504233bfa23d9990666a38: Network error: Client connection negotiation failed: client connection to 127.20.245.129:37047: connect: Connection refused (error 111)
I20260806 13:01:39.151701 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 25842
I20260806 13:01:39.158124 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 25978
I20260806 13:01:39.158226 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.157926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:37409 (local address 127.0.0.1:50638)
0806 13:01:39.158041 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.158167 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.130:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 13:01:39.164799 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 25612
2026-08-06T13:01:39Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2291 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T13:01:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:39Z Disabled control of system clock
I20260806 13:01:39.198431 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:40425
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:34577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:40425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 13:01:39.296868 26156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:39.297180 26156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:39.297209 26156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:39.298659 26156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:39.298722 26156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:39.298735 26156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:39.298749 26156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:39.298763 26156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:39.300424 26156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:40425
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:40425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:39.300751 26156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:39.301127 26156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:39.307339 26162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:39.307331 26164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:39.307327 26161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:39.307369 26156 server_base.cc:1034] running on GCE node
I20260806 13:01:39.307883 26156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:39.308354 26156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:39.309578 26156 hybrid_clock.cc:648] HybridClock initialized: now 1786021299309539 us; error 58 us; skew 500 ppm
I20260806 13:01:39.311513 26156 webserver.cc:460] Webserver started at http://127.20.245.190:32841/ using document root <none> and password file <none>
I20260806 13:01:39.311858 26156 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:39.311942 26156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:39.312125 26156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:39.313527 26156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "721c8eb824d14df1a2e419ce0eb2fff3"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "e0d235e172f284bbeefee3e6eb362103"
server_key_iv: "fcf8af068f26dc830ee305e900cb2c20"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.313992 26156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "721c8eb824d14df1a2e419ce0eb2fff3"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "e0d235e172f284bbeefee3e6eb362103"
server_key_iv: "fcf8af068f26dc830ee305e900cb2c20"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.315723 26156 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 13:01:39.316829 26170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.317180 26156 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:39.317332 26156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "721c8eb824d14df1a2e419ce0eb2fff3"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "e0d235e172f284bbeefee3e6eb362103"
server_key_iv: "fcf8af068f26dc830ee305e900cb2c20"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.317442 26156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:39.322165 26156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:39.322546 26156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:39.322719 26156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:39.328140 26156 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:40425
I20260806 13:01:39.328297 26223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:40425 every 8 connection(s)
I20260806 13:01:39.328680 26156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:39.329551 26224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:39.333256 26224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3: Bootstrap starting.
I20260806 13:01:39.334002 26224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:39.334373 26224 log.cc:824] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:39.334579 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 26156
I20260806 13:01:39.334714 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:39.334945 21462 external_mini_cluster.cc:1428] Setting key caf81fcb58d8ae91c4d4c9ccc11c0b29
I20260806 13:01:39.335516 26224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3: No bootstrap required, opened a new log
I20260806 13:01:39.338375 26224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "721c8eb824d14df1a2e419ce0eb2fff3" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40425 } }
I20260806 13:01:39.338578 26224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:39.338606 26224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 721c8eb824d14df1a2e419ce0eb2fff3, State: Initialized, Role: FOLLOWER
I20260806 13:01:39.338830 26224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "721c8eb824d14df1a2e419ce0eb2fff3" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40425 } }
I20260806 13:01:39.339000 26224 raft_consensus.cc:388] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:39.339064 26224 raft_consensus.cc:482] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:39.339136 26224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:39.339403 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.335745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39844 (local address 127.20.245.190:40425)
0806 13:01:39.336065 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.336076 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.336107 (+ 31us) server_negotiation.cc:407] Connection header received
0806 13:01:39.337138 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.337148 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.337203 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.337397 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.338502 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.338509 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.338510 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:39.338521 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.338597 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:39.338616 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.338711 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.338869 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.338954 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":122,"threads_started":1}
I20260806 13:01:39.340278 26224 raft_consensus.cc:504] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "721c8eb824d14df1a2e419ce0eb2fff3" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40425 } }
I20260806 13:01:39.340432 26224 leader_election.cc:302] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 721c8eb824d14df1a2e419ce0eb2fff3; no voters:
I20260806 13:01:39.340688 26224 leader_election.cc:288] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:39.340762 26229 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:39.340945 26229 raft_consensus.cc:686] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [term 1 LEADER]: Becoming Leader. State: Replica: 721c8eb824d14df1a2e419ce0eb2fff3, State: Running, Role: LEADER
I20260806 13:01:39.341041 26229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "721c8eb824d14df1a2e419ce0eb2fff3" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40425 } }
I20260806 13:01:39.341095 26224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:39.341547 26230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "721c8eb824d14df1a2e419ce0eb2fff3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "721c8eb824d14df1a2e419ce0eb2fff3" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40425 } } }
I20260806 13:01:39.341691 26230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:39.341522 26231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 721c8eb824d14df1a2e419ce0eb2fff3. Latest consensus state: current_term: 1 leader_uuid: "721c8eb824d14df1a2e419ce0eb2fff3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "721c8eb824d14df1a2e419ce0eb2fff3" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40425 } } }
I20260806 13:01:39.341912 26231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:39.341982 26235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:39.342605 26235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:39.344650 26235 catalog_manager.cc:1347] Generated new cluster ID: 7582d6a0602b46bf8f9a1cbe00198551
I20260806 13:01:39.344754 26235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:39.356966 26235 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:39.357265 26235 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:39.390065 26235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3: Generated new TSK 0
I20260806 13:01:39.390442 26235 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:01:39.398065 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:40425
--builtin_ntp_servers=127.20.245.148:34577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 13:01:39.500591 26248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:39.500907 26248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:39.500936 26248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:39.502504 26248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:39.502581 26248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:39.502619 26248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:39.504611 26248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:39.505010 26248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:39.505383 26248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:39.511955 26256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:39.511960 26253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:39.511958 26254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:39.512373 26248 server_base.cc:1034] running on GCE node
I20260806 13:01:39.512699 26248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:39.513038 26248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:39.514247 26248 hybrid_clock.cc:648] HybridClock initialized: now 1786021299514220 us; error 48 us; skew 500 ppm
I20260806 13:01:39.515990 26248 webserver.cc:460] Webserver started at http://127.20.245.129:33101/ using document root <none> and password file <none>
I20260806 13:01:39.516314 26248 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:39.516398 26248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:39.516578 26248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:39.517915 26248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "74f46fe54d4e404798d32184f6ec553d"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "2e4807b6c1d227920e123ebe2729c9fa"
server_key_iv: "8d55a2b645c7d36d25f603c7ff159562"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.518348 26248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "74f46fe54d4e404798d32184f6ec553d"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "2e4807b6c1d227920e123ebe2729c9fa"
server_key_iv: "8d55a2b645c7d36d25f603c7ff159562"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.520123 26248 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 13:01:39.521108 26262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.521355 26248 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:39.521495 26248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "74f46fe54d4e404798d32184f6ec553d"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "2e4807b6c1d227920e123ebe2729c9fa"
server_key_iv: "8d55a2b645c7d36d25f603c7ff159562"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.521601 26248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:39.525864 26248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:39.526247 26248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:39.526420 26248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:39.526688 26248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:39.527160 26248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:39.527274 26248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.527329 26248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:39.527355 26248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.534699 26248 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:38465
I20260806 13:01:39.534785 26376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:38465 every 8 connection(s)
I20260806 13:01:39.535315 26248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:39.535689 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 26248
I20260806 13:01:39.535830 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:39.536104 21462 external_mini_cluster.cc:1428] Setting key 04622d9cebf80db8243814940d03e3d0
I20260806 13:01:39.537391 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:40425
--builtin_ntp_servers=127.20.245.148:34577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 13:01:39.540468 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.536604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:39023 (local address 127.20.245.190:40425)
0806 13:01:39.536692 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.536695 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.537072 (+ 377us) server_negotiation.cc:407] Connection header received
0806 13:01:39.537853 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.537855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.537864 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.537940 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.540091 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.540094 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.540094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:39.540100 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.540125 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:39.540131 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.540256 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.540365 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.540385 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:01:39.540836 26379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.536615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:40425 (local address 127.20.245.129:39023)
0806 13:01:39.536896 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.536952 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.537719 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.538033 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.538039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.538054 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:39.539777 (+ 1723us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:01:39.539778 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:39.539836 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:01:39.539895 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:39.540223 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:39.540231 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:39.540236 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.540336 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.540430 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":132,"threads_started":1}
I20260806 13:01:39.541585 26377 heartbeater.cc:347] Connected to a master server at 127.20.245.190:40425
I20260806 13:01:39.541759 26377 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:39.541994 26377 heartbeater.cc:511] Master 127.20.245.190:40425 requested a full tablet report, sending...
I20260806 13:01:39.542861 26188 ts_manager.cc:194] Registered new tserver with Master: 74f46fe54d4e404798d32184f6ec553d (127.20.245.129:38465)
W20260806 13:01:39.640749 26380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:39.641173 26380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:39.641211 26380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:39.642958 26380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:39.643028 26380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:39.643064 26380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:39.645195 26380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:39.645542 26380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:39.645932 26380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:39.652689 26385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:39.652746 26388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:39.652689 26386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:39.653196 26380 server_base.cc:1034] running on GCE node
I20260806 13:01:39.653491 26380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:39.653867 26380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:39.655118 26380 hybrid_clock.cc:648] HybridClock initialized: now 1786021299655002 us; error 77 us; skew 500 ppm
I20260806 13:01:39.657099 26380 webserver.cc:460] Webserver started at http://127.20.245.130:37139/ using document root <none> and password file <none>
I20260806 13:01:39.657455 26380 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:39.657545 26380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:39.657737 26380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:39.659338 26380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "2c55514ad0204ea1b11e8d95400c09f8"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "c7344fd85052b90a683aba527f10756d"
server_key_iv: "51045d086bdd8da3ec4293c144bc04ab"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.659900 26380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "2c55514ad0204ea1b11e8d95400c09f8"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "c7344fd85052b90a683aba527f10756d"
server_key_iv: "51045d086bdd8da3ec4293c144bc04ab"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.662387 26380 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260806 13:01:39.663836 26394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.664103 26380 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:39.664244 26380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "2c55514ad0204ea1b11e8d95400c09f8"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "c7344fd85052b90a683aba527f10756d"
server_key_iv: "51045d086bdd8da3ec4293c144bc04ab"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.664381 26380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:39.669325 26380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:39.669812 26380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:39.670023 26380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:39.670347 26380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:39.670822 26380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:39.670892 26380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.670945 26380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:39.670974 26380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.679734 26380 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:41561
I20260806 13:01:39.679780 26507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:41561 every 8 connection(s)
I20260806 13:01:39.680316 26380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:39.684707 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.681481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:54355 (local address 127.20.245.190:40425)
0806 13:01:39.681642 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.681645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.681927 (+ 282us) server_negotiation.cc:407] Connection header received
0806 13:01:39.682574 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.682576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.682584 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.682676 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.684377 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.684379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.684379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:39.684384 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.684406 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:39.684412 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.684479 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.684595 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.684618 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260806 13:01:39.684917 26510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.681454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:40425 (local address 127.20.245.130:54355)
0806 13:01:39.681726 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.681785 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.682429 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.682757 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.682762 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.682773 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:39.684150 (+ 1377us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:01:39.684151 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:39.684195 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:01:39.684239 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:39.684477 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:39.684480 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:39.684484 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.684552 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.684630 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":138,"threads_started":1}
I20260806 13:01:39.685757 26508 heartbeater.cc:347] Connected to a master server at 127.20.245.190:40425
I20260806 13:01:39.685887 26508 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:39.686122 26508 heartbeater.cc:511] Master 127.20.245.190:40425 requested a full tablet report, sending...
I20260806 13:01:39.686225 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 26380
I20260806 13:01:39.686362 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:39.686604 21462 external_mini_cluster.cc:1428] Setting key ed1e65f27a78932042109078553a5f47
I20260806 13:01:39.686733 26188 ts_manager.cc:194] Registered new tserver with Master: 2c55514ad0204ea1b11e8d95400c09f8 (127.20.245.130:41561)
I20260806 13:01:39.688072 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:40425
--builtin_ntp_servers=127.20.245.148:34577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 13:01:39.790692 26511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:39.791000 26511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:39.791031 26511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:39.792706 26511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:39.792778 26511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:39.792815 26511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:39.794659 26511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:39.795109 26511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:39.795595 26511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:39.802699 26519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:39.802699 26517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:39.802721 26516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:39.803051 26511 server_base.cc:1034] running on GCE node
I20260806 13:01:39.803376 26511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:39.803674 26511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:39.804834 26511 hybrid_clock.cc:648] HybridClock initialized: now 1786021299804815 us; error 46 us; skew 500 ppm
I20260806 13:01:39.806586 26511 webserver.cc:460] Webserver started at http://127.20.245.131:34303/ using document root <none> and password file <none>
I20260806 13:01:39.806921 26511 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:39.807008 26511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:39.807246 26511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:39.808601 26511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "691298c1f712421d9a10a1392be2bd82"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "3058d857671a8f1d33281b9447af3dee"
server_key_iv: "3505d20d3e7e41883ad6450c0010912a"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.809037 26511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "691298c1f712421d9a10a1392be2bd82"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "3058d857671a8f1d33281b9447af3dee"
server_key_iv: "3505d20d3e7e41883ad6450c0010912a"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.810636 26511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 13:01:39.811681 26525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.811966 26511 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:39.812104 26511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "691298c1f712421d9a10a1392be2bd82"
format_stamp: "Formatted at 2026-08-06 13:01:39 on dist-test-slave-srgv"
server_key: "3058d857671a8f1d33281b9447af3dee"
server_key_iv: "3505d20d3e7e41883ad6450c0010912a"
server_key_version: "encryptionkey@0"
I20260806 13:01:39.812247 26511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:39.816540 26511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:39.816929 26511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:39.817106 26511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:39.817374 26511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:39.817782 26511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:39.817847 26511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.817896 26511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:39.817927 26511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:39.826335 26511 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:43617
I20260806 13:01:39.826448 26643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:43617 every 8 connection(s)
I20260806 13:01:39.826967 26511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:39.831538 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.828303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:36561 (local address 127.20.245.190:40425)
0806 13:01:39.828403 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.828406 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.828740 (+ 334us) server_negotiation.cc:407] Connection header received
0806 13:01:39.829407 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.829409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.829425 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.829490 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.831145 (+ 1655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.831146 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.831147 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:39.831153 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.831231 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:39.831239 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.831318 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.831429 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.831448 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 13:01:39.831766 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.828279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:40425 (local address 127.20.245.131:36561)
0806 13:01:39.828551 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.828623 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.829224 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.829579 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.829609 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.829620 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:39.830879 (+ 1259us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:01:39.830880 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:39.830923 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:01:39.830964 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:39.831317 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:39.831322 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:39.831326 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.831401 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.831475 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":138,"threads_started":1}
I20260806 13:01:39.832455 26644 heartbeater.cc:347] Connected to a master server at 127.20.245.190:40425
I20260806 13:01:39.832625 26644 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:39.832840 26644 heartbeater.cc:511] Master 127.20.245.190:40425 requested a full tablet report, sending...
I20260806 13:01:39.833451 26188 ts_manager.cc:194] Registered new tserver with Master: 691298c1f712421d9a10a1392be2bd82 (127.20.245.131:43617)
I20260806 13:01:39.835918 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 26511
I20260806 13:01:39.836030 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:39.836243 21462 external_mini_cluster.cc:1428] Setting key 1a72f27d4d30a537190231be6d8517c4
I20260806 13:01:39.837631 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:01:39.841204 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.839678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39846 (local address 127.20.245.190:40425)
0806 13:01:39.839854 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.839856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.839939 (+ 83us) server_negotiation.cc:407] Connection header received
0806 13:01:39.840060 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.840061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.840075 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.840146 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.840908 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.840909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.840910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:39.840916 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.840936 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:39.840941 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.841006 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.841077 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.841096 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260806 13:01:39.843958 26188 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39846:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:39.846308 26188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:39.853188 26652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.850556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:38465 (local address 127.0.0.1:57422)
0806 13:01:39.850759 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.850822 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.850899 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.851720 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.851721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.851725 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:39.852529 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:01:39.852529 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:39.852556 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:01:39.852595 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:39.852974 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:39.852976 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:39.852977 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.853033 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.853055 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":116,"threads_started":1}
I20260806 13:01:39.853214 26656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.851120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42682 (local address 127.20.245.130:41561)
0806 13:01:39.851411 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.851420 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.851433 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:01:39.851471 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.851475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.851489 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.851592 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.852721 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.852736 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.852737 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:39.852742 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.852795 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:39.852838 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.852923 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.853061 (+ 138us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.853082 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":160,"threads_started":1}
I20260806 13:01:39.853343 26654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.850687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57422 (local address 127.20.245.129:38465)
0806 13:01:39.851526 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.851531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.851543 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:39.851579 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.851581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.851591 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.851957 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.852755 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.852769 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.852769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:39.852775 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.852826 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:39.852873 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.852974 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.853110 (+ 136us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.853131 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":128,"threads_started":1}
I20260806 13:01:39.853607 26655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.850580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:41561 (local address 127.0.0.1:42682)
0806 13:01:39.850973 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.850985 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.851041 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.851594 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.851603 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.851614 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:39.852529 (+ 915us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:01:39.852529 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:39.852556 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:01:39.852595 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:39.852937 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:39.852946 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:39.852950 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.853032 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.853052 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":109,"threads_started":1}
I20260806 13:01:39.854367 26653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.850877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:43617 (local address 127.0.0.1:38360)
0806 13:01:39.851281 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:39.851293 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:39.851347 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:39.851723 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:39.851724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:39.851726 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:39.852942 (+ 1216us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:01:39.852943 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:39.852952 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:01:39.852964 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:39.854206 (+ 1242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:39.854207 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:39.854208 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 13:01:39.854271 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 13:01:39.854290 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":55,"threads_started":1}
I20260806 13:01:39.854401 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:39.851289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38360 (local address 127.20.245.131:43617)
0806 13:01:39.851553 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:39.851558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:39.851569 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:39.851598 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:39.851601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:39.851611 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:39.852590 (+ 979us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:39.854007 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:39.854019 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:39.854019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:39.854026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:39.854085 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:39.854117 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:39.854200 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:39.854286 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 13:01:39.854303 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":161,"threads_started":1}
I20260806 13:01:39.854404 26310 tablet_service.cc:1467] Processing CreateTablet for tablet 27af7844e41e43e38e9e7cbe9ca1bf60 (DEFAULT_TABLE table=test-table [id=859cca457ef14e2ab8f3e4b5ef90bf5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:39.854403 26442 tablet_service.cc:1467] Processing CreateTablet for tablet 27af7844e41e43e38e9e7cbe9ca1bf60 (DEFAULT_TABLE table=test-table [id=859cca457ef14e2ab8f3e4b5ef90bf5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:39.854928 26310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27af7844e41e43e38e9e7cbe9ca1bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:39.854928 26442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27af7844e41e43e38e9e7cbe9ca1bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:39.855152 26576 tablet_service.cc:1467] Processing CreateTablet for tablet 27af7844e41e43e38e9e7cbe9ca1bf60 (DEFAULT_TABLE table=test-table [id=859cca457ef14e2ab8f3e4b5ef90bf5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:39.855557 26576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27af7844e41e43e38e9e7cbe9ca1bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:39.859366 26658 tablet_bootstrap.cc:492] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Bootstrap starting.
I20260806 13:01:39.859756 26660 tablet_bootstrap.cc:492] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d: Bootstrap starting.
I20260806 13:01:39.860255 26658 tablet_bootstrap.cc:654] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:39.860524 26660 tablet_bootstrap.cc:654] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:39.860638 26658 log.cc:824] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:39.860919 26660 log.cc:824] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:39.861407 26659 tablet_bootstrap.cc:492] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Bootstrap starting.
I20260806 13:01:39.861564 26658 tablet_bootstrap.cc:492] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: No bootstrap required, opened a new log
I20260806 13:01:39.861658 26658 ts_tablet_manager.cc:1397] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:39.861991 26660 tablet_bootstrap.cc:492] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d: No bootstrap required, opened a new log
I20260806 13:01:39.862102 26660 ts_tablet_manager.cc:1397] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:39.862288 26659 tablet_bootstrap.cc:654] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:39.862708 26659 log.cc:824] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:39.863795 26659 tablet_bootstrap.cc:492] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: No bootstrap required, opened a new log
I20260806 13:01:39.863886 26659 ts_tablet_manager.cc:1397] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:01:39.864481 26658 raft_consensus.cc:348] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:39.864651 26658 raft_consensus.cc:374] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:39.864675 26658 raft_consensus.cc:729] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691298c1f712421d9a10a1392be2bd82, State: Initialized, Role: FOLLOWER
I20260806 13:01:39.864877 26658 consensus_queue.cc:260] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:39.865209 26644 heartbeater.cc:503] Master 127.20.245.190:40425 was elected leader, sending a full tablet report...
I20260806 13:01:39.865206 26658 ts_tablet_manager.cc:1428] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 13:01:39.865892 26660 raft_consensus.cc:348] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:39.866302 26660 raft_consensus.cc:374] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:39.866396 26660 raft_consensus.cc:729] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74f46fe54d4e404798d32184f6ec553d, State: Initialized, Role: FOLLOWER
I20260806 13:01:39.866559 26660 consensus_queue.cc:260] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:39.866957 26660 ts_tablet_manager.cc:1428] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260806 13:01:39.867247 26377 heartbeater.cc:503] Master 127.20.245.190:40425 was elected leader, sending a full tablet report...
I20260806 13:01:39.867805 26659 raft_consensus.cc:348] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:39.868001 26659 raft_consensus.cc:374] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:39.868048 26659 raft_consensus.cc:729] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c55514ad0204ea1b11e8d95400c09f8, State: Initialized, Role: FOLLOWER
I20260806 13:01:39.868242 26659 consensus_queue.cc:260] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:39.868618 26659 ts_tablet_manager.cc:1428] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 13:01:39.868618 26508 heartbeater.cc:503] Master 127.20.245.190:40425 was elected leader, sending a full tablet report...
W20260806 13:01:39.931310 26509 tablet.cc:2369] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:01:40.036732 26378 tablet.cc:2369] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:01:40.077926 26645 tablet.cc:2369] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:40.196112 26665 raft_consensus.cc:482] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:40.196346 26665 raft_consensus.cc:504] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:40.196906 26665 leader_election.cc:288] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c55514ad0204ea1b11e8d95400c09f8 (127.20.245.130:41561), 691298c1f712421d9a10a1392be2bd82 (127.20.245.131:43617)
I20260806 13:01:40.199160 26656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.197528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:55609 (local address 127.20.245.130:41561)
0806 13:01:40.197675 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:40.197677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:40.197715 (+ 38us) server_negotiation.cc:407] Connection header received
0806 13:01:40.197814 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:40.197815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:40.197824 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:40.197890 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:40.198818 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:40.198820 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:40.198821 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:40.198826 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:40.198853 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:40.198858 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:40.198927 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:40.198996 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 13:01:40.199012 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 13:01:40.199141 26667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.197400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:41561 (local address 127.20.245.129:55609)
0806 13:01:40.197613 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:40.197629 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:40.197707 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:40.197930 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:40.197932 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:40.197943 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:40.198652 (+ 709us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:01:40.198653 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:40.198662 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:01:40.198677 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:40.198924 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:40.198925 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:40.198926 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 13:01:40.198982 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 13:01:40.199001 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":118,"threads_started":1}
I20260806 13:01:40.199214 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.197844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:56693 (local address 127.20.245.131:43617)
0806 13:01:40.197941 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:40.197943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:40.197955 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:40.197997 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:40.197998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:40.198003 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:40.198071 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:40.198903 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:40.198905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:40.198905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:40.198910 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:40.198929 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:40.198933 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:40.199020 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:40.199079 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 13:01:40.199097 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 13:01:40.199281 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.197713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:43617 (local address 127.20.245.129:56693)
0806 13:01:40.197827 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:40.197836 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:40.197907 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:40.198083 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:40.198084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:40.198114 (+ 30us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:40.198766 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:01:40.198767 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:40.198775 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:01:40.198791 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:40.199020 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:40.199021 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:40.199022 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 13:01:40.199082 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:01:40.199096 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":57,"threads_started":1}
I20260806 13:01:40.199824 26462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27af7844e41e43e38e9e7cbe9ca1bf60" candidate_uuid: "74f46fe54d4e404798d32184f6ec553d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c55514ad0204ea1b11e8d95400c09f8" is_pre_election: true
I20260806 13:01:40.199983 26596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27af7844e41e43e38e9e7cbe9ca1bf60" candidate_uuid: "74f46fe54d4e404798d32184f6ec553d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691298c1f712421d9a10a1392be2bd82" is_pre_election: true
I20260806 13:01:40.200073 26462 raft_consensus.cc:2454] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f46fe54d4e404798d32184f6ec553d in term 0.
I20260806 13:01:40.200156 26596 raft_consensus.cc:2454] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f46fe54d4e404798d32184f6ec553d in term 0.
I20260806 13:01:40.200405 26265 leader_election.cc:302] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c55514ad0204ea1b11e8d95400c09f8, 74f46fe54d4e404798d32184f6ec553d; no voters:
I20260806 13:01:40.200560 26665 raft_consensus.cc:2781] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:40.200673 26665 raft_consensus.cc:482] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:40.200789 26665 raft_consensus.cc:3037] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:40.201782 26665 raft_consensus.cc:504] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:40.201939 26665 leader_election.cc:288] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [CANDIDATE]: Term 1 election: Requested vote from peers 2c55514ad0204ea1b11e8d95400c09f8 (127.20.245.130:41561), 691298c1f712421d9a10a1392be2bd82 (127.20.245.131:43617)
I20260806 13:01:40.202345 26596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27af7844e41e43e38e9e7cbe9ca1bf60" candidate_uuid: "74f46fe54d4e404798d32184f6ec553d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691298c1f712421d9a10a1392be2bd82"
I20260806 13:01:40.202324 26462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27af7844e41e43e38e9e7cbe9ca1bf60" candidate_uuid: "74f46fe54d4e404798d32184f6ec553d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c55514ad0204ea1b11e8d95400c09f8"
I20260806 13:01:40.202461 26462 raft_consensus.cc:3037] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:40.202461 26596 raft_consensus.cc:3037] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:40.203810 26596 raft_consensus.cc:2454] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f46fe54d4e404798d32184f6ec553d in term 1.
I20260806 13:01:40.203802 26462 raft_consensus.cc:2454] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f46fe54d4e404798d32184f6ec553d in term 1.
I20260806 13:01:40.204119 26265 leader_election.cc:302] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691298c1f712421d9a10a1392be2bd82, 74f46fe54d4e404798d32184f6ec553d; no voters:
I20260806 13:01:40.204298 26665 raft_consensus.cc:2781] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:40.204612 26665 raft_consensus.cc:686] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 1 LEADER]: Becoming Leader. State: Replica: 74f46fe54d4e404798d32184f6ec553d, State: Running, Role: LEADER
I20260806 13:01:40.204802 26665 consensus_queue.cc:237] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } }
I20260806 13:01:40.206179 26188 catalog_manager.cc:5495] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d reported cstate change: term changed from 0 to 1, leader changed from <none> to 74f46fe54d4e404798d32184f6ec553d (127.20.245.129). New cstate: current_term: 1 leader_uuid: "74f46fe54d4e404798d32184f6ec553d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f46fe54d4e404798d32184f6ec553d" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 38465 } health_report { overall_health: HEALTHY } } }
I20260806 13:01:40.213660 26654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.212219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57434 (local address 127.20.245.129:38465)
0806 13:01:40.212309 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:40.212311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:40.212319 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:01:40.212376 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:40.212377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:40.212397 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:40.212465 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:40.213316 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:40.213320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:40.213321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:40.213332 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:40.213352 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:40.213357 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:40.213426 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:40.213485 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 13:01:40.213504 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 13:01:40.216730 26462 raft_consensus.cc:1261] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 1 FOLLOWER]: Refusing update from remote peer 74f46fe54d4e404798d32184f6ec553d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:40.217293 26665 consensus_queue.cc:1035] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c55514ad0204ea1b11e8d95400c09f8" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:40.217497 26596 raft_consensus.cc:1261] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 1 FOLLOWER]: Refusing update from remote peer 74f46fe54d4e404798d32184f6ec553d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:40.217906 26665 consensus_queue.cc:1035] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [LEADER]: Connected to new peer: Peer: permanent_uuid: "691298c1f712421d9a10a1392be2bd82" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:40.220881 26673 mvcc.cc:205] Tried to move back new op lower bound from 7315543245683068928 to 7315543245639921664. Current Snapshot: MvccSnapshot[applied={T|T < 7315543245683068928}]
I20260806 13:01:40.221347 26672 mvcc.cc:205] Tried to move back new op lower bound from 7315543245683068928 to 7315543245639921664. Current Snapshot: MvccSnapshot[applied={T|T < 7315543245683068928}]
I20260806 13:01:40.222031 26675 mvcc.cc:205] Tried to move back new op lower bound from 7315543245683068928 to 7315543245639921664. Current Snapshot: MvccSnapshot[applied={T|T < 7315543245683068928}]
I20260806 13:01:40.224675 26187 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:40.224823 26187 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:40.225976 26187 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 721c8eb824d14df1a2e419ce0eb2fff3: Sending DeleteTablet for 3 replicas of tablet 27af7844e41e43e38e9e7cbe9ca1bf60
I20260806 13:01:40.226541 26442 tablet_service.cc:1514] Processing DeleteTablet for tablet 27af7844e41e43e38e9e7cbe9ca1bf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:40 UTC) from {username='slave'} at 127.0.0.1:42682
I20260806 13:01:40.226596 26576 tablet_service.cc:1514] Processing DeleteTablet for tablet 27af7844e41e43e38e9e7cbe9ca1bf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:40 UTC) from {username='slave'} at 127.0.0.1:38360
I20260806 13:01:40.226583 26310 tablet_service.cc:1514] Processing DeleteTablet for tablet 27af7844e41e43e38e9e7cbe9ca1bf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:40 UTC) from {username='slave'} at 127.0.0.1:57422
I20260806 13:01:40.226907 26683 tablet_replica.cc:330] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d: stopping tablet replica
I20260806 13:01:40.227026 26683 raft_consensus.cc:2229] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:40.227205 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 26248
I20260806 13:01:40.227241 26683 raft_consensus.cc:2258] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 74f46fe54d4e404798d32184f6ec553d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:40.227389 26682 tablet_replica.cc:330] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: stopping tablet replica
I20260806 13:01:40.227591 26682 raft_consensus.cc:2229] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:40.227782 26682 raft_consensus.cc:2258] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:40.228669 26682 ts_tablet_manager.cc:1905] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:40.231362 26682 ts_tablet_manager.cc:1918] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:40.231491 26682 log.cc:1196] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/27af7844e41e43e38e9e7cbe9ca1bf60
I20260806 13:01:40.231817 26682 ts_tablet_manager.cc:1939] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 2c55514ad0204ea1b11e8d95400c09f8: Deleting consensus metadata
I20260806 13:01:40.232441 26173 catalog_manager.cc:4841] TS 2c55514ad0204ea1b11e8d95400c09f8 (127.20.245.130:41561): tablet 27af7844e41e43e38e9e7cbe9ca1bf60 (table test-table [id=859cca457ef14e2ab8f3e4b5ef90bf5d]) successfully deleted
W20260806 13:01:40.237454 26171 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:38465 (error 108)
I20260806 13:01:40.237548 26681 tablet_replica.cc:330] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: stopping tablet replica
I20260806 13:01:40.237668 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 26380
I20260806 13:01:40.237727 26681 raft_consensus.cc:2229] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:40.237900 26681 raft_consensus.cc:2258] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:40.239576 26653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.238007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:38465 (local address 127.0.0.1:42818)
0806 13:01:40.239422 (+ 1415us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:40.239521 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:38465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1364}
W20260806 13:01:40.240064 26171 catalog_manager.cc:4584] TS 74f46fe54d4e404798d32184f6ec553d (127.20.245.129:38465): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 27af7844e41e43e38e9e7cbe9ca1bf60: Network error: Client connection negotiation failed: client connection to 127.20.245.129:38465: connect: Connection refused (error 111)
I20260806 13:01:40.242126 26681 ts_tablet_manager.cc:1905] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:40.244887 26681 ts_tablet_manager.cc:1918] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:40.245019 26681 log.cc:1196] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/27af7844e41e43e38e9e7cbe9ca1bf60
I20260806 13:01:40.245194 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 26511
I20260806 13:01:40.245404 26681 ts_tablet_manager.cc:1939] T 27af7844e41e43e38e9e7cbe9ca1bf60 P 691298c1f712421d9a10a1392be2bd82: Deleting consensus metadata
I20260806 13:01:40.252417 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 26156
I20260806 13:01:40.252614 26653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.252386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:43617 (local address 127.0.0.1:35874)
0806 13:01:40.252476 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:40.252542 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.131:43617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
2026-08-06T13:01:40Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1086 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 13:01:40.276088 21462 mini_oidc.cc:152] Starting JWKS server
I20260806 13:01:40.277554 21462 webserver.cc:460] Webserver started at https://127.0.0.1:39803/ using document root <none> and password file <none>
I20260806 13:01:40.277671 21462 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 13:01:40.277894 21462 webserver.cc:460] Webserver started at http://127.0.0.1:40629/ using document root <none> and password file <none>
2026-08-06T13:01:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:40Z Disabled control of system clock
I20260806 13:01:40.289266 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43057
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:34811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:43057
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39803/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/testchainca.cert with env {}
W20260806 13:01:40.391115 26690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:40.391471 26690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:40.391501 26690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:40.393019 26690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:40.393095 26690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:40.393111 26690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:40.393127 26690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:40.393141 26690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 13:01:40.393157 26690 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 13:01:40.393169 26690 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39803/jwks.json
I20260806 13:01:40.395267 26690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:43057
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39803/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:40.395690 26690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:40.396034 26690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:40.402520 26695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:40.402520 26696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:40.402549 26699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:40.402943 26690 server_base.cc:1034] running on GCE node
I20260806 13:01:40.403328 26690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:40.403766 26690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:40.404968 26690 hybrid_clock.cc:648] HybridClock initialized: now 1786021300404939 us; error 51 us; skew 500 ppm
I20260806 13:01:40.407539 26690 webserver.cc:460] Webserver started at http://127.20.245.190:41485/ using document root <none> and password file <none>
I20260806 13:01:40.407909 26690 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:40.408021 26690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:40.408238 26690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:40.409722 26690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "27b6fbcb2d114b3baa2faeca95fd7e60"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "ff436ef93cd09254282e3eb11bbf465e"
server_key_iv: "d943db9dc0d543dba0bec0a92bc108fa"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.410440 26690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "27b6fbcb2d114b3baa2faeca95fd7e60"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "ff436ef93cd09254282e3eb11bbf465e"
server_key_iv: "d943db9dc0d543dba0bec0a92bc108fa"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.413168 26690 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260806 13:01:40.414928 26705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:40.415364 26690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:40.415508 26690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "27b6fbcb2d114b3baa2faeca95fd7e60"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "ff436ef93cd09254282e3eb11bbf465e"
server_key_iv: "d943db9dc0d543dba0bec0a92bc108fa"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.415663 26690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:40.427069 26690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:40.427613 26690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:40.427814 26690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:40.432922 26690 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:43057
I20260806 13:01:40.432996 26758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:43057 every 8 connection(s)
I20260806 13:01:40.433502 26690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:40.434850 26759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:40.437261 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 26690
I20260806 13:01:40.437435 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:40.437647 21462 external_mini_cluster.cc:1428] Setting key d56944d316fab87e0204149b31956c74
I20260806 13:01:40.438486 26759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60: Bootstrap starting.
I20260806 13:01:40.439342 26759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:40.439790 26759 log.cc:824] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:40.440713 26759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60: No bootstrap required, opened a new log
I20260806 13:01:40.443519 26759 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b6fbcb2d114b3baa2faeca95fd7e60" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43057 } }
I20260806 13:01:40.443805 26759 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:40.443861 26759 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27b6fbcb2d114b3baa2faeca95fd7e60, State: Initialized, Role: FOLLOWER
I20260806 13:01:40.444057 26759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b6fbcb2d114b3baa2faeca95fd7e60" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43057 } }
I20260806 13:01:40.444157 26759 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:40.444186 26759 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:40.444221 26759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:40.444985 26762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.438383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49654 (local address 127.20.245.190:43057)
0806 13:01:40.438703 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:40.438712 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:40.438745 (+ 33us) server_negotiation.cc:407] Connection header received
0806 13:01:40.439341 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:40.439351 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:40.439452 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:40.439636 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:40.439951 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.441060 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.442264 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.442751 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.442853 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:40.443991 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:40.443996 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:40.443997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:40.444325 (+ 328us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:40.444372 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:40.444385 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:40.444446 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:40.444558 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 13:01:40.444650 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":128,"threads_started":1}
I20260806 13:01:40.445158 26759 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b6fbcb2d114b3baa2faeca95fd7e60" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43057 } }
I20260806 13:01:40.445287 26759 leader_election.cc:302] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27b6fbcb2d114b3baa2faeca95fd7e60; no voters:
I20260806 13:01:40.445537 26759 leader_election.cc:288] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:40.445662 26764 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:40.445852 26764 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [term 1 LEADER]: Becoming Leader. State: Replica: 27b6fbcb2d114b3baa2faeca95fd7e60, State: Running, Role: LEADER
I20260806 13:01:40.445915 26759 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:40.445992 26764 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b6fbcb2d114b3baa2faeca95fd7e60" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43057 } }
I20260806 13:01:40.446338 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:01:40.446473 26764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27b6fbcb2d114b3baa2faeca95fd7e60. Latest consensus state: current_term: 1 leader_uuid: "27b6fbcb2d114b3baa2faeca95fd7e60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b6fbcb2d114b3baa2faeca95fd7e60" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43057 } } }
I20260806 13:01:40.446568 26764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:40.446733 26765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27b6fbcb2d114b3baa2faeca95fd7e60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b6fbcb2d114b3baa2faeca95fd7e60" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43057 } } }
I20260806 13:01:40.446803 26765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:40.446938 26771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:40.447728 26771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:40.449880 26771 catalog_manager.cc:1347] Generated new cluster ID: a552829f51c1443e9757e06cd0cc9dc3
I20260806 13:01:40.449950 26771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:40.459569 26771 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:40.460533 26771 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:40.468111 26771 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27b6fbcb2d114b3baa2faeca95fd7e60: Generated new TSK 0
I20260806 13:01:40.468461 26771 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 13:01:40.499671 26789 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 13:01:40.499943 26789 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 13:01:40.500174 26762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.481349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49656 (local address 127.20.245.190:43057)
0806 13:01:40.481429 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:40.481432 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:40.481563 (+ 131us) server_negotiation.cc:407] Connection header received
0806 13:01:40.481724 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:40.481725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:40.481746 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:40.481833 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0806 13:01:40.482022 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.482904 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.484048 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.484419 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.484514 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:40.484994 (+ 480us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 13:01:40.499824 (+ 14830us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 13:01:40.500063 (+ 239us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":41}
W20260806 13:01:40.500301 26762 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 13:01:40.500927 26788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:40.481161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:43057 (local address 127.0.0.1:49656)
0806 13:01:40.481461 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:40.481473 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:40.481576 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:40.481856 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:40.481857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:40.481860 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0806 13:01:40.481947 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:40.481949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.483051 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.483052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:40.483930 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:40.483936 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.484626 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.484627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:40.484704 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:40.484747 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 13:01:40.500225 (+ 15478us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 13:01:40.500453 (+ 228us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.245.190:43057: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":150,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.245.190:43057: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 13:01:40.501633 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 26690
2026-08-06T13:01:40Z chronyd exiting
I20260806 13:01:40.541471 21462 test_util.cc:175] -----------------------------------------------
I20260806 13:01:40.541633 21462 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786021275077601-21462-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (267 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 13:01:40.543037 21462 mini_oidc.cc:152] Starting JWKS server
I20260806 13:01:40.544067 21462 webserver.cc:460] Webserver started at https://127.0.0.1:33605/ using document root <none> and password file <none>
I20260806 13:01:40.544183 21462 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 13:01:40.544428 21462 webserver.cc:460] Webserver started at http://127.0.0.1:33683/ using document root <none> and password file <none>
2026-08-06T13:01:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:40Z Disabled control of system clock
I20260806 13:01:40.556488 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43381
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:43349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:43381
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33605/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/testchainca.cert with env {}
W20260806 13:01:40.662585 26795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:40.662997 26795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:40.663050 26795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:40.664786 26795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:40.664894 26795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:40.664918 26795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:40.664943 26795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:40.664975 26795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 13:01:40.665007 26795 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 13:01:40.665035 26795 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33605/jwks.json
I20260806 13:01:40.667112 26795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:43381
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33605/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:40.667563 26795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:40.667855 26795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:40.674583 26801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:40.674600 26800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:40.674600 26803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:40.674973 26795 server_base.cc:1034] running on GCE node
I20260806 13:01:40.675392 26795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:40.675904 26795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:40.677125 26795 hybrid_clock.cc:648] HybridClock initialized: now 1786021300677104 us; error 55 us; skew 500 ppm
I20260806 13:01:40.678901 26795 webserver.cc:460] Webserver started at http://127.20.245.190:46187/ using document root <none> and password file <none>
I20260806 13:01:40.679378 26795 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:40.679476 26795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:40.679718 26795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:40.681428 26795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "96b36af463aa442aa58ed057ae9cff8d"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "e46e456dd83e88e06bc6a907559d5f77"
server_key_iv: "443f6b4ff15964e408df6e8733511976"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.681957 26795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "96b36af463aa442aa58ed057ae9cff8d"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "e46e456dd83e88e06bc6a907559d5f77"
server_key_iv: "443f6b4ff15964e408df6e8733511976"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.683826 26795 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 13:01:40.684952 26809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:40.685324 26795 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:40.685470 26795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "96b36af463aa442aa58ed057ae9cff8d"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "e46e456dd83e88e06bc6a907559d5f77"
server_key_iv: "443f6b4ff15964e408df6e8733511976"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.685581 26795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:40.699592 26795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:40.700044 26795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:40.700239 26795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:40.705627 26795 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:43381
I20260806 13:01:40.705719 26863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:43381 every 8 connection(s)
I20260806 13:01:40.706234 26795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:40.707549 26864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:40.710474 26864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d: Bootstrap starting.
I20260806 13:01:40.711238 26864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:40.711560 26864 log.cc:824] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:40.712392 26864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d: No bootstrap required, opened a new log
I20260806 13:01:40.714216 26864 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b36af463aa442aa58ed057ae9cff8d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43381 } }
I20260806 13:01:40.714442 26864 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:40.714486 26864 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96b36af463aa442aa58ed057ae9cff8d, State: Initialized, Role: FOLLOWER
I20260806 13:01:40.714607 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 26795
I20260806 13:01:40.714727 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:40.714695 26864 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b36af463aa442aa58ed057ae9cff8d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43381 } }
I20260806 13:01:40.714799 26864 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:40.714844 26864 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:40.714897 26864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:40.714953 21462 external_mini_cluster.cc:1428] Setting key ce446f47f214a2ca41ec832d7fb7755d
I20260806 13:01:40.715751 26864 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b36af463aa442aa58ed057ae9cff8d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43381 } }
I20260806 13:01:40.715910 26864 leader_election.cc:302] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96b36af463aa442aa58ed057ae9cff8d; no voters:
I20260806 13:01:40.716125 26864 leader_election.cc:288] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:40.716169 26869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:40.716326 26869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [term 1 LEADER]: Becoming Leader. State: Replica: 96b36af463aa442aa58ed057ae9cff8d, State: Running, Role: LEADER
I20260806 13:01:40.716429 26869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b36af463aa442aa58ed057ae9cff8d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43381 } }
I20260806 13:01:40.716466 26864 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:40.716828 26870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96b36af463aa442aa58ed057ae9cff8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b36af463aa442aa58ed057ae9cff8d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43381 } } }
I20260806 13:01:40.716921 26870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:40.717208 26871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96b36af463aa442aa58ed057ae9cff8d. Latest consensus state: current_term: 1 leader_uuid: "96b36af463aa442aa58ed057ae9cff8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b36af463aa442aa58ed057ae9cff8d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43381 } } }
I20260806 13:01:40.717350 26871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:40.717558 26875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:40.718266 26875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:40.720176 26875 catalog_manager.cc:1347] Generated new cluster ID: 0c943d01da3342778341e1fa4d05d329
I20260806 13:01:40.720237 26875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:40.722759 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.715722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45276 (local address 127.20.245.190:43381)
0806 13:01:40.716087 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:40.716097 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:40.716155 (+ 58us) server_negotiation.cc:407] Connection header received
0806 13:01:40.716385 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:40.716396 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:40.716484 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:40.716957 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:40.717064 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.719041 (+ 1977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.720259 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.720903 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.721026 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:40.721923 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:40.721928 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:40.721928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:40.722186 (+ 258us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:40.722233 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:40.722249 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:40.722315 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:40.722422 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 13:01:40.722509 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":128,"threads_started":1}
I20260806 13:01:40.724035 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:01:40.728876 26875 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:40.729660 26875 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:40.733773 26875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96b36af463aa442aa58ed057ae9cff8d: Generated new TSK 0
I20260806 13:01:40.734062 26875 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 13:01:40.760237 26894 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 13:01:40.760396 26894 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 13:01:40.760941 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.742736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45284 (local address 127.20.245.190:43381)
0806 13:01:40.742807 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:40.742810 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:40.742942 (+ 132us) server_negotiation.cc:407] Connection header received
0806 13:01:40.743022 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:40.743023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:40.743038 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:40.743130 (+ 92us) server_negotiation.cc:226] Negotiated authn=JWT
0806 13:01:40.743387 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.743964 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.745400 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.745665 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.745737 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:40.746031 (+ 294us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 13:01:40.760567 (+ 14536us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 13:01:40.760830 (+ 263us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45284: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":39}
W20260806 13:01:40.761037 26868 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45284: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 13:01:40.761073 26893 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:40.742608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:43381 (local address 127.0.0.1:45284)
0806 13:01:40.742828 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:40.742841 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:40.742934 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:40.743149 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:40.743150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:40.743153 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0806 13:01:40.743266 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:40.743269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.744099 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.744100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:40.745151 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:40.745155 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.745760 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.745761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:40.745834 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:40.745843 (+ 9us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 13:01:40.760762 (+ 14919us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 13:01:40.760920 (+ 158us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.245.190:43381: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":136,"threads_started":1}
I20260806 13:01:40.761550 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 26795
2026-08-06T13:01:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (260 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 13:01:40.803009 21462 mini_oidc.cc:152] Starting JWKS server
I20260806 13:01:40.803966 21462 webserver.cc:460] Webserver started at https://127.0.0.1:41949/ using document root <none> and password file <none>
I20260806 13:01:40.804024 21462 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 13:01:40.804203 21462 webserver.cc:460] Webserver started at http://127.0.0.1:42559/ using document root <none> and password file <none>
2026-08-06T13:01:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:40Z Disabled control of system clock
I20260806 13:01:40.814769 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43981
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:34459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:43981
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41949/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 13:01:40.915567 26900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:40.915910 26900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:40.915938 26900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:40.917464 26900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:40.917534 26900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:40.917548 26900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:40.917562 26900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:40.917575 26900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 13:01:40.917588 26900 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 13:01:40.917600 26900 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41949/jwks.json
I20260806 13:01:40.919472 26900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:43981
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41949/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:40.919869 26900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:40.920295 26900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:40.926487 26905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:40.926476 26906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:40.926515 26900 server_base.cc:1034] running on GCE node
W20260806 13:01:40.926476 26908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:40.927106 26900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:40.927533 26900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:40.928740 26900 hybrid_clock.cc:648] HybridClock initialized: now 1786021300928688 us; error 62 us; skew 500 ppm
I20260806 13:01:40.930745 26900 webserver.cc:460] Webserver started at http://127.20.245.190:36609/ using document root <none> and password file <none>
I20260806 13:01:40.931032 26900 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:40.931097 26900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:40.931313 26900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:40.932770 26900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "8cc910520dcc4665a38c2249a020ec50"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "a8a003feb346c01ce3a88f01ff82262e"
server_key_iv: "f7a3bca99101d0fcbeca2778d7fec3da"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.933204 26900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "8cc910520dcc4665a38c2249a020ec50"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "a8a003feb346c01ce3a88f01ff82262e"
server_key_iv: "f7a3bca99101d0fcbeca2778d7fec3da"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.934966 26900 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:40.936233 26914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:40.936486 26900 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:40.936599 26900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "8cc910520dcc4665a38c2249a020ec50"
format_stamp: "Formatted at 2026-08-06 13:01:40 on dist-test-slave-srgv"
server_key: "a8a003feb346c01ce3a88f01ff82262e"
server_key_iv: "f7a3bca99101d0fcbeca2778d7fec3da"
server_key_version: "encryptionkey@0"
I20260806 13:01:40.936686 26900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:40.955783 26900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:40.956238 26900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:40.956377 26900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:40.961534 26900 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:43981
I20260806 13:01:40.961701 26966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:43981 every 8 connection(s)
I20260806 13:01:40.962096 26900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:40.963101 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:40.967486 26967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50: Bootstrap starting.
I20260806 13:01:40.968317 26967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:40.968700 26967 log.cc:824] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:40.969667 26967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50: No bootstrap required, opened a new log
I20260806 13:01:40.971652 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 26900
I20260806 13:01:40.971765 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:40.972002 21462 external_mini_cluster.cc:1428] Setting key 828a29d4996cea36c982a52bd5a80c04
I20260806 13:01:40.972102 26967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc910520dcc4665a38c2249a020ec50" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43981 } }
I20260806 13:01:40.972393 26967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:40.972442 26967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc910520dcc4665a38c2249a020ec50, State: Initialized, Role: FOLLOWER
I20260806 13:01:40.972669 26967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc910520dcc4665a38c2249a020ec50" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43981 } }
I20260806 13:01:40.972800 26967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:40.972849 26967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:40.972913 26967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:40.974052 26967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc910520dcc4665a38c2249a020ec50" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43981 } }
I20260806 13:01:40.974215 26967 leader_election.cc:302] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cc910520dcc4665a38c2249a020ec50; no voters:
I20260806 13:01:40.974414 26967 leader_election.cc:288] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:40.974774 26972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:40.974782 26967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:40.974954 26972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [term 1 LEADER]: Becoming Leader. State: Replica: 8cc910520dcc4665a38c2249a020ec50, State: Running, Role: LEADER
I20260806 13:01:40.975072 26972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc910520dcc4665a38c2249a020ec50" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43981 } }
I20260806 13:01:40.975812 26973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cc910520dcc4665a38c2249a020ec50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc910520dcc4665a38c2249a020ec50" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43981 } } }
I20260806 13:01:40.975934 26974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cc910520dcc4665a38c2249a020ec50. Latest consensus state: current_term: 1 leader_uuid: "8cc910520dcc4665a38c2249a020ec50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc910520dcc4665a38c2249a020ec50" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43981 } } }
I20260806 13:01:40.976001 26974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:40.975950 26973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:40.976341 26981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:40.977104 26981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:40.979238 26981 catalog_manager.cc:1347] Generated new cluster ID: c0696acbd49e43428b71a8d7a616ee7f
I20260806 13:01:40.979316 26981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:40.979945 26971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:40.972802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47168 (local address 127.20.245.190:43981)
0806 13:01:40.973139 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:40.973151 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:40.973200 (+ 49us) server_negotiation.cc:407] Connection header received
0806 13:01:40.973373 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:40.973382 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:40.973471 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:40.973674 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:40.973942 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.975585 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.977132 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:40.977817 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:40.978623 (+ 806us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:40.979012 (+ 389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:40.979016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:40.979016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:40.979343 (+ 327us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:40.979396 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:40.979416 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:40.979491 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:40.979588 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 13:01:40.979686 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":134,"threads_started":1}
I20260806 13:01:40.981215 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:01:40.986500 26981 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:40.987149 26981 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:40.992120 26981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cc910520dcc4665a38c2249a020ec50: Generated new TSK 0
I20260806 13:01:40.992498 26981 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:01:41.006171 26971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:41.001199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.20.245.190:43981)
0806 13:01:41.001284 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:41.001287 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:41.001449 (+ 162us) server_negotiation.cc:407] Connection header received
0806 13:01:41.001597 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:41.001598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:41.001612 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:41.001712 (+ 100us) server_negotiation.cc:226] Negotiated authn=JWT
0806 13:01:41.001881 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.002517 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.003533 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.003785 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.003874 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:41.004126 (+ 252us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 13:01:41.005867 (+ 1741us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41949/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 13:01:41.006044 (+ 177us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47174: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41949/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 13:01:41.006268 26971 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47174: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41949/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 13:01:41.008301 26997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:41.001116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:43981 (local address 127.0.0.1:47174)
0806 13:01:41.001361 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:41.001371 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:41.001474 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:41.001711 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:41.001712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:41.001714 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 13:01:41.001804 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:41.001807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.002660 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.002661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:41.003430 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:41.003433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.003880 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.003882 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:41.003958 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:41.003966 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 13:01:41.005994 (+ 2028us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41949/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 13:01:41.008166 (+ 2172us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.245.190:43981: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41949/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":1814,"thread_start_us":149,"threads_started":1}
I20260806 13:01:41.008978 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 26900
E20260806 13:01:41.017963 26998 webserver.cc:533] Webserver: sslize failed:
E20260806 13:01:41.018123 26998 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T13:01:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (246 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T13:01:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:41Z Disabled control of system clock
I20260806 13:01:41.060702 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36123
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:33891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:36123
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/testchainca.cert with env {}
W20260806 13:01:41.162730 27002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:41.163049 27002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:41.163092 27002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:41.164871 27002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:41.164955 27002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:41.164969 27002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:41.164983 27002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:41.164996 27002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 13:01:41.165010 27002 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 13:01:41.165022 27002 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 13:01:41.167084 27002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:33891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:36123
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:41.167550 27002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:41.167857 27002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:41.174032 27008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:41.174032 27009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:41.174052 27011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:41.174474 27002 server_base.cc:1034] running on GCE node
I20260806 13:01:41.174808 27002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:41.175266 27002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:41.176450 27002 hybrid_clock.cc:648] HybridClock initialized: now 1786021301176429 us; error 61 us; skew 500 ppm
I20260806 13:01:41.178201 27002 webserver.cc:460] Webserver started at http://127.20.245.190:34367/ using document root <none> and password file <none>
I20260806 13:01:41.178539 27002 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:41.178617 27002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:41.178792 27002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:41.180213 27002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "ef9386582f444e1e85fa5932db62121a"
format_stamp: "Formatted at 2026-08-06 13:01:41 on dist-test-slave-srgv"
server_key: "467ec221fb5a37386ad48164593d841b"
server_key_iv: "bb5c8c08abfca2a80a465986af4a52bb"
server_key_version: "encryptionkey@0"
I20260806 13:01:41.180667 27002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "ef9386582f444e1e85fa5932db62121a"
format_stamp: "Formatted at 2026-08-06 13:01:41 on dist-test-slave-srgv"
server_key: "467ec221fb5a37386ad48164593d841b"
server_key_iv: "bb5c8c08abfca2a80a465986af4a52bb"
server_key_version: "encryptionkey@0"
I20260806 13:01:41.182480 27002 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 13:01:41.183547 27017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:41.183774 27002 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:41.183894 27002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "ef9386582f444e1e85fa5932db62121a"
format_stamp: "Formatted at 2026-08-06 13:01:41 on dist-test-slave-srgv"
server_key: "467ec221fb5a37386ad48164593d841b"
server_key_iv: "bb5c8c08abfca2a80a465986af4a52bb"
server_key_version: "encryptionkey@0"
I20260806 13:01:41.183997 27002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:41.200023 27002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:41.200603 27002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:41.200815 27002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:41.207297 27002 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:36123
I20260806 13:01:41.207336 27069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:36123 every 8 connection(s)
I20260806 13:01:41.208038 27002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:41.208824 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 27002
I20260806 13:01:41.208963 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:41.209204 21462 external_mini_cluster.cc:1428] Setting key 6c54e80bd1701d1240feab4e7317ae31
I20260806 13:01:41.209899 27070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:41.214447 27070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a: Bootstrap starting.
I20260806 13:01:41.215533 27070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:41.215977 27070 log.cc:824] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:41.217087 27070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a: No bootstrap required, opened a new log
I20260806 13:01:41.217331 27073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:41.209985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37270 (local address 127.20.245.190:36123)
0806 13:01:41.210316 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:41.210327 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:41.210371 (+ 44us) server_negotiation.cc:407] Connection header received
0806 13:01:41.211047 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:41.211060 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:41.211222 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:41.211431 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:41.211824 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.213375 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.214414 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.215125 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.215363 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:41.216406 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:41.216411 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:41.216412 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:01:41.216658 (+ 246us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:41.216716 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:01:41.216735 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:41.216812 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:41.216914 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 13:01:41.217022 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":162,"threads_started":1}
I20260806 13:01:41.218900 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:01:41.220180 27070 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9386582f444e1e85fa5932db62121a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36123 } }
I20260806 13:01:41.220463 27070 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:41.220515 27070 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9386582f444e1e85fa5932db62121a, State: Initialized, Role: FOLLOWER
I20260806 13:01:41.220711 27070 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9386582f444e1e85fa5932db62121a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36123 } }
I20260806 13:01:41.220822 27070 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:41.220851 27070 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:41.220909 27070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:41.222249 27070 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9386582f444e1e85fa5932db62121a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36123 } }
I20260806 13:01:41.222409 27070 leader_election.cc:302] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef9386582f444e1e85fa5932db62121a; no voters:
I20260806 13:01:41.222622 27070 leader_election.cc:288] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:41.222766 27075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:41.222965 27075 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [term 1 LEADER]: Becoming Leader. State: Replica: ef9386582f444e1e85fa5932db62121a, State: Running, Role: LEADER
I20260806 13:01:41.223052 27070 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:41.223088 27075 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9386582f444e1e85fa5932db62121a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36123 } }
I20260806 13:01:41.223837 27076 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef9386582f444e1e85fa5932db62121a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9386582f444e1e85fa5932db62121a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36123 } } }
I20260806 13:01:41.223910 27077 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9386582f444e1e85fa5932db62121a. Latest consensus state: current_term: 1 leader_uuid: "ef9386582f444e1e85fa5932db62121a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9386582f444e1e85fa5932db62121a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36123 } } }
I20260806 13:01:41.223984 27076 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:41.224001 27077 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a [sys.catalog]: This master's current role is: LEADER
W20260806 13:01:41.226111 27091 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:01:41.226215 27091 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:01:41.226423 27082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:41.226702 27082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:41.229357 27082 catalog_manager.cc:1347] Generated new cluster ID: 0a01a77d59924dd49d8d483d0f510729
I20260806 13:01:41.229453 27082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:41.239248 27082 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:41.240036 27082 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:41.245577 27082 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef9386582f444e1e85fa5932db62121a: Generated new TSK 0
I20260806 13:01:41.245900 27082 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:01:42.129904 27073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:41.253646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37278 (local address 127.20.245.190:36123)
0806 13:01:41.253735 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:41.253738 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:41.253858 (+ 120us) server_negotiation.cc:407] Connection header received
0806 13:01:41.253985 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:41.253990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:41.254007 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:41.254101 (+ 94us) server_negotiation.cc:226] Negotiated authn=JWT
0806 13:01:41.254359 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.254972 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.255971 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.256209 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.256297 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:41.256535 (+ 238us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 13:01:42.129461 (+872926us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 13:01:42.129782 (+ 321us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37278: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 13:01:42.130021 27099 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:41.253534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36123 (local address 127.0.0.1:37278)
0806 13:01:41.253750 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:41.253763 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:41.253879 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:41.254171 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:41.254172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:41.254174 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 13:01:41.254257 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:41.254260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.255099 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.255100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:41.255863 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:41.255866 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:41.256303 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:41.256304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:41.256374 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:41.256382 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 13:01:42.129700 (+873318us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 13:01:42.129870 (+ 170us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.245.190:36123: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":123,"threads_started":1}
W20260806 13:01:42.130033 27073 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37278: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260806 13:01:42.130398 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 27002
2026-08-06T13:01:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1101 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (139 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (114 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:43 dist-test-slave-srgv krb5kdc[27111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:43 dist-test-slave-srgv krb5kdc[27111](info): set up 2 sockets
Aug 06 13:01:43 dist-test-slave-srgv krb5kdc[27111](info): commencing operation
krb5kdc: starting...
W20260806 13:01:44.982854 21462 mini_kdc.cc:121] Time spent starting KDC: real 2.577s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:45 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:45.141603 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35219
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:35219
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:45.258242 27124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:45.258678 27124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:45.258735 27124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:45.260705 27124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:45.260842 27124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:45.260871 27124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:45.260900 27124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:45.260933 27124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:45.263366 27124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:35219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:45.263829 27124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:45.264159 27124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:45.271500 27132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:45.271500 27130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:45.271538 27129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:45.272002 27124 server_base.cc:1034] running on GCE node
I20260806 13:01:45.272480 27124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:45.272967 27124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:45.274256 27124 hybrid_clock.cc:648] HybridClock initialized: now 1786021305274222 us; error 71 us; skew 500 ppm
Aug 06 13:01:45 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:45.284412 27124 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:45.285243 27124 webserver.cc:460] Webserver started at http://127.20.245.190:38401/ using document root <none> and password file <none>
I20260806 13:01:45.285627 27124 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:45.285719 27124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:45.285912 27124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:45.287581 27124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "b9c2d429cfc6445aab141b6046f4146a"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "39fe60f9db4e3a7667eee80747baab2f"
server_key_iv: "bf4ffc6e70ea697c36fe3cf87ed38950"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.288101 27124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "b9c2d429cfc6445aab141b6046f4146a"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "39fe60f9db4e3a7667eee80747baab2f"
server_key_iv: "bf4ffc6e70ea697c36fe3cf87ed38950"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.290102 27124 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:45.291579 27139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:45.291927 27124 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:45.292093 27124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "b9c2d429cfc6445aab141b6046f4146a"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "39fe60f9db4e3a7667eee80747baab2f"
server_key_iv: "bf4ffc6e70ea697c36fe3cf87ed38950"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.292236 27124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:45.306324 27124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:45.310405 27124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:45.310693 27124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:45.316620 27124 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:35219
I20260806 13:01:45.316694 27193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:35219 every 8 connection(s)
I20260806 13:01:45.317250 27124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:45.318482 27194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:45.320578 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 27124
I20260806 13:01:45.320744 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:45.320971 21462 external_mini_cluster.cc:1428] Setting key 13d44ad3f164105c4dc4c22d6d908105
I20260806 13:01:45.322693 27194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a: Bootstrap starting.
I20260806 13:01:45.323791 27194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:45.324277 27194 log.cc:824] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:45.325276 27194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a: No bootstrap required, opened a new log
I20260806 13:01:45.328404 27194 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2d429cfc6445aab141b6046f4146a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35219 } }
I20260806 13:01:45.328703 27194 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:45.328763 27194 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c2d429cfc6445aab141b6046f4146a, State: Initialized, Role: FOLLOWER
I20260806 13:01:45.328954 27194 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2d429cfc6445aab141b6046f4146a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35219 } }
I20260806 13:01:45.329074 27194 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:45.329115 27194 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:45.329182 27194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:45.330339 27194 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2d429cfc6445aab141b6046f4146a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35219 } }
I20260806 13:01:45.330474 27194 leader_election.cc:302] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9c2d429cfc6445aab141b6046f4146a; no voters:
I20260806 13:01:45.330776 27194 leader_election.cc:288] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 06 13:01:45 dist-test-slave-srgv krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:45.330852 27199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:45.331079 27199 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [term 1 LEADER]: Becoming Leader. State: Replica: b9c2d429cfc6445aab141b6046f4146a, State: Running, Role: LEADER
I20260806 13:01:45.331230 27194 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:45.331370 27199 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2d429cfc6445aab141b6046f4146a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35219 } }
I20260806 13:01:45.332707 27201 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9c2d429cfc6445aab141b6046f4146a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2d429cfc6445aab141b6046f4146a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35219 } } }
I20260806 13:01:45.332844 27201 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:45.333473 27200 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9c2d429cfc6445aab141b6046f4146a. Latest consensus state: current_term: 1 leader_uuid: "b9c2d429cfc6445aab141b6046f4146a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9c2d429cfc6445aab141b6046f4146a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35219 } } }
I20260806 13:01:45.333566 27200 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a [sys.catalog]: This master's current role is: LEADER
W20260806 13:01:45.333969 27213 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:01:45.334066 27213 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:01:45.334226 27214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:45.334451 27214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:45.336840 27214 catalog_manager.cc:1347] Generated new cluster ID: e1d465857fb94bedb472fa64071e880d
I20260806 13:01:45.336911 27214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:45.336951 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:45.321885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.20.245.190:35219)
0806 13:01:45.322194 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:45.322205 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:45.322242 (+ 37us) server_negotiation.cc:407] Connection header received
0806 13:01:45.322823 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:45.322852 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:45.322952 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:45.323127 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:45.324269 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.325684 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.326911 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.327542 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.327656 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:45.331654 (+ 3998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:45.331660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:45.331661 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:45.331680 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:45.334506 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:45.335060 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:45.335065 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:45.335066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:45.335264 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:45.335536 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:45.335538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:45.335539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:45.335935 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:45.336148 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:45.336473 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 13:01:45.336649 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":121,"threads_started":1}
I20260806 13:01:45.355875 27214 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:45.356805 27214 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:45.362957 27214 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9c2d429cfc6445aab141b6046f4146a: Generated new TSK 0
I20260806 13:01:45.363315 27214 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:45.400501 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35219
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:45.532311 27220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:45.532761 27220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:45.532804 27220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:45.535036 27220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:45.535396 27220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:45.535463 27220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:45.538134 27220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:45.538615 27220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:45.538983 27220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:45.547248 27225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:45.548044 27226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:45.548015 27228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:45.548264 27220 server_base.cc:1034] running on GCE node
I20260806 13:01:45.548581 27220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:45.548923 27220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:45.550256 27220 hybrid_clock.cc:648] HybridClock initialized: now 1786021305550132 us; error 146 us; skew 500 ppm
Aug 06 13:01:45 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:45.555759 27220 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:45.556571 27220 webserver.cc:460] Webserver started at http://127.20.245.129:37103/ using document root <none> and password file <none>
I20260806 13:01:45.556939 27220 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:45.557029 27220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:45.557235 27220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:45.558784 27220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "261aadb7124e40bfac04470c5d1a9eaf"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "bcb5a0acf8724312932fb7c1f05803aa"
server_key_iv: "11319744d75ee4455aae0788f947af8b"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.559376 27220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "261aadb7124e40bfac04470c5d1a9eaf"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "bcb5a0acf8724312932fb7c1f05803aa"
server_key_iv: "11319744d75ee4455aae0788f947af8b"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.561349 27220 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:45.562901 27235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:45.563448 27220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:45.563611 27220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "261aadb7124e40bfac04470c5d1a9eaf"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "bcb5a0acf8724312932fb7c1f05803aa"
server_key_iv: "11319744d75ee4455aae0788f947af8b"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.563815 27220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:45.581528 27220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:45.585930 27220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:45.586191 27220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:45.586581 27220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:45.587039 27220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:45.587102 27220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:45.587152 27220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:45.587285 27220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:45.595467 27220 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:45363
I20260806 13:01:45.595724 27349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:45363 every 8 connection(s)
I20260806 13:01:45.596192 27220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:45.600807 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 27220
I20260806 13:01:45.600966 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:45.601222 21462 external_mini_cluster.cc:1428] Setting key 969f8a86d2586938b9059debda722980
Aug 06 13:01:45 dist-test-slave-srgv krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:45.610008 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:45.597349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:54881 (local address 127.20.245.190:35219)
0806 13:01:45.597434 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:45.597436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:45.597753 (+ 317us) server_negotiation.cc:407] Connection header received
0806 13:01:45.598860 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:45.598861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:45.598886 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:45.598961 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:45.599944 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.600542 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.602072 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.602390 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.602455 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:45.605954 (+ 3499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:45.605957 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:45.605958 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:45.605991 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:45.607768 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:45.608462 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:45.608464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:45.608464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:45.608549 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:45.608968 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:45.608970 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:45.608970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:45.609169 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:45.609243 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:45.609773 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 13:01:45.609909 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 13:01:45.610324 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:45.597358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35219 (local address 127.20.245.129:54881)
0806 13:01:45.597543 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:45.597595 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:45.598727 (+ 1132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:45.599037 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:45.599042 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:45.599510 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:45.599826 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:45.599835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.600706 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.600707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:45.601987 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:45.601991 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.602502 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.602503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:45.602688 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:45.603502 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:45.603516 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:45.605773 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:45.607889 (+ 2116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:45.607905 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:45.607910 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:45.608360 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:45.608634 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:45.608635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:45.608635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:45.608829 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:45.609264 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:45.609272 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:45.609530 (+ 258us) client_negotiation.cc:769] Sending connection context
0806 13:01:45.609693 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 13:01:45.609974 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":98,"threads_started":1}
I20260806 13:01:45.611269 27350 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35219
I20260806 13:01:45.611433 27350 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:45.611753 27350 heartbeater.cc:511] Master 127.20.245.190:35219 requested a full tablet report, sending...
I20260806 13:01:45.612638 27157 ts_manager.cc:194] Registered new tserver with Master: 261aadb7124e40bfac04470c5d1a9eaf (127.20.245.129:45363)
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:01:45.613473 27157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:54881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:45.648280 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35219
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:45.756456 27355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:45.756762 27355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:45.756793 27355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:45.758348 27355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:45.758419 27355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:45.758455 27355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:45.760339 27355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:45.760635 27355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:45.760888 27355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:45.767009 27363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:45.767017 27360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:45.767019 27361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:45.767357 27355 server_base.cc:1034] running on GCE node
I20260806 13:01:45.767849 27355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:45.768195 27355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:45.769426 27355 hybrid_clock.cc:648] HybridClock initialized: now 1786021305769394 us; error 43 us; skew 500 ppm
Aug 06 13:01:45 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:45.772980 27355 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:45.773628 27355 webserver.cc:460] Webserver started at http://127.20.245.130:44365/ using document root <none> and password file <none>
I20260806 13:01:45.774008 27355 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:45.774068 27355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:45.774259 27355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:45.775839 27355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "46af3bd9f838401e8a947c888bcf27cd"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "3fcfef7c411a933d7f75ed7292c6df3e"
server_key_iv: "bf9b360adc7bc14d37923a2d744647d8"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.776371 27355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "46af3bd9f838401e8a947c888bcf27cd"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "3fcfef7c411a933d7f75ed7292c6df3e"
server_key_iv: "bf9b360adc7bc14d37923a2d744647d8"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.778251 27355 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:45.779385 27370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:45.779774 27355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:45.779915 27355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "46af3bd9f838401e8a947c888bcf27cd"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "3fcfef7c411a933d7f75ed7292c6df3e"
server_key_iv: "bf9b360adc7bc14d37923a2d744647d8"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.780032 27355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:45.793776 27355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:45.797639 27355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:45.797974 27355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:45.798363 27355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:45.798844 27355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:45.798887 27355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:45.798919 27355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:45.798933 27355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:45.808058 27355 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:38125
I20260806 13:01:45.808287 27487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:38125 every 8 connection(s)
I20260806 13:01:45.808669 27355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:45.817510 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 27355
I20260806 13:01:45.817672 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:45.817997 21462 external_mini_cluster.cc:1428] Setting key 15e5c5566b30b917555fc758b8ecf514
Aug 06 13:01:45 dist-test-slave-srgv krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:45.823388 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:45.809948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:41173 (local address 127.20.245.190:35219)
0806 13:01:45.810055 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:45.810058 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:45.810346 (+ 288us) server_negotiation.cc:407] Connection header received
0806 13:01:45.811816 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:45.811819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:45.811841 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:45.811942 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:45.813035 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.813743 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.815149 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.815469 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.815569 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:45.818905 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:45.818908 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:45.818908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:45.818920 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:45.820805 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:45.821730 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:45.821733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:45.821733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:45.821835 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:45.822229 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:45.822231 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:45.822231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:45.822409 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:45.822506 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:45.823011 (+ 505us) server_negotiation.cc:299] Negotiation successful
0806 13:01:45.823291 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 13:01:45.823745 27490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:45.809898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35219 (local address 127.20.245.130:41173)
0806 13:01:45.810128 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:45.810179 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:45.811591 (+ 1412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:45.812060 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:45.812065 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:45.812583 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:45.812882 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:45.812889 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.813930 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.813931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:45.814985 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:45.814989 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:45.815599 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:45.815600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:45.815799 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:45.816601 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:45.816612 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:45.818742 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:45.820959 (+ 2217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:45.820977 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:45.820981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:45.821487 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:45.821929 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:45.821931 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:45.821931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:45.822128 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:45.822506 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:45.822518 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:45.822792 (+ 274us) client_negotiation.cc:769] Sending connection context
0806 13:01:45.822948 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 13:01:45.823341 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":103,"threads_started":1}
I20260806 13:01:45.824496 27488 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35219
I20260806 13:01:45.824671 27488 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:45.824993 27488 heartbeater.cc:511] Master 127.20.245.190:35219 requested a full tablet report, sending...
I20260806 13:01:45.825594 27157 ts_manager.cc:194] Registered new tserver with Master: 46af3bd9f838401e8a947c888bcf27cd (127.20.245.130:38125)
I20260806 13:01:45.826097 27157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:41173
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:45.860471 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35219
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:45.973613 27493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:45.974011 27493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:45.974066 27493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:45.976159 27493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:45.976276 27493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:45.976348 27493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:45.978870 27493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:45.979398 27493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:45.979750 27493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:45.986502 27498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:45.986524 27499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:45.986558 27501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:45.987035 27493 server_base.cc:1034] running on GCE node
I20260806 13:01:45.987432 27493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:45.987876 27493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:45.989100 27493 hybrid_clock.cc:648] HybridClock initialized: now 1786021305989078 us; error 55 us; skew 500 ppm
Aug 06 13:01:45 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:45.993167 27493 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:45.993893 27493 webserver.cc:460] Webserver started at http://127.20.245.131:40753/ using document root <none> and password file <none>
I20260806 13:01:45.994263 27493 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:45.994359 27493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:45.994557 27493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:45.996325 27493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "77114f0b631b4b2cb99e94bb4f454782"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "50cccad8cc89dc7791205a9c18ceeca2"
server_key_iv: "c9f729491424083c1be9088d3b0bd655"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.996893 27493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "77114f0b631b4b2cb99e94bb4f454782"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "50cccad8cc89dc7791205a9c18ceeca2"
server_key_iv: "c9f729491424083c1be9088d3b0bd655"
server_key_version: "encryptionkey@0"
I20260806 13:01:45.998965 27493 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:46.000222 27508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:46.000586 27493 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:46.000758 27493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "77114f0b631b4b2cb99e94bb4f454782"
format_stamp: "Formatted at 2026-08-06 13:01:45 on dist-test-slave-srgv"
server_key: "50cccad8cc89dc7791205a9c18ceeca2"
server_key_iv: "c9f729491424083c1be9088d3b0bd655"
server_key_version: "encryptionkey@0"
I20260806 13:01:46.000882 27493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:46.027371 27493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:46.030766 27493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:46.031114 27493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:46.031531 27493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:46.032128 27493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:46.032176 27493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:46.032274 27493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:46.032291 27493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:46.041052 27493 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:40823
I20260806 13:01:46.041102 27624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:40823 every 8 connection(s)
I20260806 13:01:46.041558 27493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:46.049346 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 27493
I20260806 13:01:46.049511 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021305, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:46.049772 21462 external_mini_cluster.cc:1428] Setting key 7ae6e0f2e6a3f65dbb0a70b632e4c688
I20260806 13:01:46.054592 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:46.042636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:56251 (local address 127.20.245.190:35219)
0806 13:01:46.042726 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:46.042728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:46.042937 (+ 209us) server_negotiation.cc:407] Connection header received
0806 13:01:46.044141 (+ 1204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:46.044143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:46.044159 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:46.044235 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:46.045165 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.045800 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.046961 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.047231 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.047295 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:46.050685 (+ 3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:46.050703 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:46.050703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:46.050714 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:46.052676 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:46.053291 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:46.053293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:46.053293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:46.053374 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:46.053686 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:46.053687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:46.053688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:46.053859 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:46.053939 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:46.054337 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 13:01:46.054475 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 13:01:46.054900 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:46.042577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35219 (local address 127.20.245.131:56251)
0806 13:01:46.042767 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:46.042822 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:46.044000 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:46.044403 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:46.044408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:46.044761 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:46.045014 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:46.045019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.045914 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.045915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:46.046865 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:46.046868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.047340 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.047341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:46.047462 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:46.048102 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:46.048113 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:46.050358 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:46.052818 (+ 2460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:46.052834 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:46.052837 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:46.053180 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:46.053454 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:46.053455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:46.053455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:46.053611 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:46.053938 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:46.053947 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:46.054161 (+ 214us) client_negotiation.cc:769] Sending connection context
0806 13:01:46.054304 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 13:01:46.054529 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
I20260806 13:01:46.055665 27625 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35219
I20260806 13:01:46.055814 27625 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:46.056056 27625 heartbeater.cc:511] Master 127.20.245.190:35219 requested a full tablet report, sending...
I20260806 13:01:46.056636 27157 ts_manager.cc:194] Registered new tserver with Master: 77114f0b631b4b2cb99e94bb4f454782 (127.20.245.131:40823)
I20260806 13:01:46.057255 27157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:56251
I20260806 13:01:46.062897 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/test-admin.keytab.
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:46.086524 21462 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 13:01:46.088994 27632 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:46.087888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.20.245.129:45363)
0806 13:01:46.088064 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:46.088076 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:46.088087 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:46.088165 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:46.088168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:46.088188 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:46.088305 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:46.088855 (+ 550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44024: BlockingRecv error: recv got EOF from 127.0.0.1:44024 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
W20260806 13:01:46.089200 21462 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5cc' of type FILE
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:46.090701 21462 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:46.091941 21462 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:46.103534 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:46.092778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44028 (local address 127.20.245.129:45363)
0806 13:01:46.092903 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:46.092906 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:46.092921 (+ 15us) server_negotiation.cc:407] Connection header received
0806 13:01:46.092990 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:46.092991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:46.093006 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:46.093058 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:46.093767 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.094713 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.095663 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.096088 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.096158 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:46.099512 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:46.099526 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:46.099526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:46.099537 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:46.101919 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:46.102385 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:46.102388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:46.102389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:46.102456 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:46.102749 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:46.102749 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:46.102750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:46.102966 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:46.103117 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:46.103268 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 13:01:46.103370 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260806 13:01:46.106570 27632 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:46.105647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44042 (local address 127.20.245.129:45363)
0806 13:01:46.105721 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:46.105723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:46.105779 (+ 56us) server_negotiation.cc:407] Connection header received
0806 13:01:46.105852 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:46.105853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:46.105866 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:46.105923 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:46.106507 (+ 584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44042: BlockingRecv error: recv got EOF from 127.0.0.1:44042 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 13:01:46.106681 21462 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5cc' of type FILE
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:46.108109 21462 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:46.109287 21462 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:46.119064 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:46.110381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44050 (local address 127.20.245.129:45363)
0806 13:01:46.110459 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:46.110462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:46.110472 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:01:46.110523 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:46.110524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:46.110536 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:46.110595 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:46.111263 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.111880 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.112813 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.113049 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.113118 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:46.116071 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:46.116073 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:46.116073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:46.116084 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:46.117795 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:46.118218 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:46.118219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:46.118219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:46.118306 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:46.118496 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:46.118496 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:46.118497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:46.118611 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:46.118696 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:46.118806 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 13:01:46.118899 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 13:01:46.121373 27632 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:46.120688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44066 (local address 127.20.245.129:45363)
0806 13:01:46.120775 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:46.120777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:46.120855 (+ 78us) server_negotiation.cc:407] Connection header received
0806 13:01:46.120916 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:46.120917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:46.120927 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:46.120976 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:46.121298 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44066: BlockingRecv error: recv got EOF from 127.0.0.1:44066 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 13:01:46.121634 21462 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786021275077601-21462-0/krb5kdc/krb5cc' of type FILE
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:46.123064 21462 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:46.124318 21462 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:01:46.133633 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:46.125078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44082 (local address 127.20.245.129:45363)
0806 13:01:46.125167 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:46.125169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:46.125256 (+ 87us) server_negotiation.cc:407] Connection header received
0806 13:01:46.125317 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:46.125318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:46.125330 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:46.125388 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:46.125848 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.126389 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.127395 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:46.127631 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:46.127714 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:46.130464 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:46.130466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:46.130467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:46.130476 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:46.132431 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:46.132812 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:46.132813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:46.132814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:46.132872 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:46.133065 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:46.133065 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:46.133066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:46.133185 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:46.133333 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:46.133410 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 13:01:46.133483 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:01:46.134572 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 27220
I20260806 13:01:46.141723 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 27355
I20260806 13:01:46.148809 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 27493
I20260806 13:01:46.155062 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 27124
2026-08-06T13:01:46Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3775 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27645](info): set up 2 sockets
Aug 06 13:01:46 dist-test-slave-srgv krb5kdc[27645](info): commencing operation
krb5kdc: starting...
W20260806 13:01:47.281178 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:47 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:47Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.190.keytab.
Entry for principal oryx/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.190.keytab.
I20260806 13:01:47.443377 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:38107
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.190.keytab
--principal=oryx/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:38107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:47.553122 27658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:47.553473 27658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:47.553503 27658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:47.555239 27658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:47.555317 27658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:47.555333 27658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:47.555347 27658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:47.555361 27658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:47.557518 27658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:38107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.190.keytab
--principal=oryx/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:38107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:47.557932 27658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:47.558280 27658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:47.564757 27666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:47.564702 27664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:47.564730 27663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:47.565166 27658 server_base.cc:1034] running on GCE node
I20260806 13:01:47.565498 27658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:47.565955 27658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:47.567301 27658 hybrid_clock.cc:648] HybridClock initialized: now 1786021307567247 us; error 73 us; skew 500 ppm
Aug 06 13:01:47 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:47.570960 27658 init.cc:377] Logged in from keytab as oryx/127.20.245.190@KRBTEST.COM (short username oryx)
I20260806 13:01:47.571758 27658 webserver.cc:460] Webserver started at http://127.20.245.190:40647/ using document root <none> and password file <none>
I20260806 13:01:47.572072 27658 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:47.572227 27658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:47.572436 27658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:47.573905 27658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "50ddcad9609d42f19b5fd95c712d5b71"
format_stamp: "Formatted at 2026-08-06 13:01:47 on dist-test-slave-srgv"
server_key: "b3745b986b68da9dc2104d54d8c7aea3"
server_key_iv: "85da0f2df96a020c35bc25211ab490ce"
server_key_version: "encryptionkey@0"
I20260806 13:01:47.574414 27658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "50ddcad9609d42f19b5fd95c712d5b71"
format_stamp: "Formatted at 2026-08-06 13:01:47 on dist-test-slave-srgv"
server_key: "b3745b986b68da9dc2104d54d8c7aea3"
server_key_iv: "85da0f2df96a020c35bc25211ab490ce"
server_key_version: "encryptionkey@0"
I20260806 13:01:47.576437 27658 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260806 13:01:47.577453 27673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:47.577706 27658 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:47.577838 27658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "50ddcad9609d42f19b5fd95c712d5b71"
format_stamp: "Formatted at 2026-08-06 13:01:47 on dist-test-slave-srgv"
server_key: "b3745b986b68da9dc2104d54d8c7aea3"
server_key_iv: "85da0f2df96a020c35bc25211ab490ce"
server_key_version: "encryptionkey@0"
I20260806 13:01:47.577932 27658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:47.589833 27658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:47.593032 27658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:47.593323 27658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:47.599201 27658 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:38107
I20260806 13:01:47.599323 27726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:38107 every 8 connection(s)
I20260806 13:01:47.599798 27658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:47.601178 27727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:47.601758 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 27658
I20260806 13:01:47.601897 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:47.602267 21462 external_mini_cluster.cc:1428] Setting key 995e71b24142f0b7e83a677ef2ed8489
I20260806 13:01:47.605154 27727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: Bootstrap starting.
I20260806 13:01:47.606269 27727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:47.606837 27727 log.cc:824] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:47.607998 27727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: No bootstrap required, opened a new log
Aug 06 13:01:47 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:47.611065 27727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } }
I20260806 13:01:47.611418 27727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:47.611454 27727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ddcad9609d42f19b5fd95c712d5b71, State: Initialized, Role: FOLLOWER
I20260806 13:01:47.611672 27727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } }
I20260806 13:01:47.611815 27727 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:47.611860 27727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:47.611924 27727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:47.613044 27727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } }
I20260806 13:01:47.613215 27727 leader_election.cc:302] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50ddcad9609d42f19b5fd95c712d5b71; no voters:
I20260806 13:01:47.613467 27727 leader_election.cc:288] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:47.613547 27732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:47.613763 27732 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 1 LEADER]: Becoming Leader. State: Replica: 50ddcad9609d42f19b5fd95c712d5b71, State: Running, Role: LEADER
I20260806 13:01:47.613845 27727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:47.613925 27732 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } }
I20260806 13:01:47.614373 27734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } }
I20260806 13:01:47.614490 27734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:47.614362 27732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50ddcad9609d42f19b5fd95c712d5b71. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } }
I20260806 13:01:47.615051 27732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:47.615484 27738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:47.616596 27738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:47.616961 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:47.603086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52798 (local address 127.20.245.190:38107)
0806 13:01:47.603371 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:47.603382 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:47.603415 (+ 33us) server_negotiation.cc:407] Connection header received
0806 13:01:47.603889 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:47.603897 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:47.603953 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:47.604141 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:47.604959 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:47.606022 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:47.607365 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:47.608134 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:47.608286 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:47.611865 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:47.611872 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:47.611872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:47.611892 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:47.614342 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:47.614946 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:47.614950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:47.614951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:47.615081 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:47.615405 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:47.615406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:47.615407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:47.615972 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:47.616250 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:47.616553 (+ 303us) server_negotiation.cc:299] Negotiation successful
0806 13:01:47.616744 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":131,"threads_started":1}
I20260806 13:01:47.618778 27738 catalog_manager.cc:1347] Generated new cluster ID: dd3ce48949614c53ab5b831e38566709
I20260806 13:01:47.618848 27738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:47.629000 27738 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:47.629802 27738 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:47.642373 27738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: Generated new TSK 0
I20260806 13:01:47.642736 27738 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab.
Entry for principal oryx/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab.
I20260806 13:01:47.687315 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38107
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab
--principal=oryx/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:47.812330 27753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:47.812646 27753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:47.812680 27753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:47.814399 27753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:47.814478 27753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:47.814514 27753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:47.816778 27753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab
--principal=oryx/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:47.817186 27753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:47.817523 27753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:47.824055 27758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:47.824136 27759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:47.824055 27761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:47.824118 27753 server_base.cc:1034] running on GCE node
I20260806 13:01:47.824752 27753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:47.825107 27753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:47.826303 27753 hybrid_clock.cc:648] HybridClock initialized: now 1786021307826295 us; error 37 us; skew 500 ppm
Aug 06 13:01:47 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:47.829715 27753 init.cc:377] Logged in from keytab as oryx/127.20.245.129@KRBTEST.COM (short username oryx)
I20260806 13:01:47.830390 27753 webserver.cc:460] Webserver started at http://127.20.245.129:35019/ using document root <none> and password file <none>
I20260806 13:01:47.830694 27753 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:47.830776 27753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:47.830976 27753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:47.832515 27753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "2e3b447560a046c58c1b59fcbf4d6bbc"
format_stamp: "Formatted at 2026-08-06 13:01:47 on dist-test-slave-srgv"
server_key: "cba3e693f883e40f7edf8a406d854c36"
server_key_iv: "ff518c74d18100c10c0e66d3327f0db5"
server_key_version: "encryptionkey@0"
I20260806 13:01:47.833038 27753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "2e3b447560a046c58c1b59fcbf4d6bbc"
format_stamp: "Formatted at 2026-08-06 13:01:47 on dist-test-slave-srgv"
server_key: "cba3e693f883e40f7edf8a406d854c36"
server_key_iv: "ff518c74d18100c10c0e66d3327f0db5"
server_key_version: "encryptionkey@0"
I20260806 13:01:47.835059 27753 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:47.836309 27768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:47.836635 27753 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:47.836786 27753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "2e3b447560a046c58c1b59fcbf4d6bbc"
format_stamp: "Formatted at 2026-08-06 13:01:47 on dist-test-slave-srgv"
server_key: "cba3e693f883e40f7edf8a406d854c36"
server_key_iv: "ff518c74d18100c10c0e66d3327f0db5"
server_key_version: "encryptionkey@0"
I20260806 13:01:47.836907 27753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:47.862203 27753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:47.865252 27753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:47.865479 27753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:47.865819 27753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:47.866250 27753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:47.866315 27753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:47.866358 27753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:47.866390 27753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:47.873896 27753 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:44889
I20260806 13:01:47.873976 27882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:44889 every 8 connection(s)
I20260806 13:01:47.874460 27753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:47.876801 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 27753
I20260806 13:01:47.876901 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:47.877260 21462 external_mini_cluster.cc:1428] Setting key e189ccb9d2a9ce2554f5a06a47af661c
Aug 06 13:01:47 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:01:47.889856 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:47.875537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:47061 (local address 127.20.245.190:38107)
0806 13:01:47.875645 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:47.875648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:47.875932 (+ 284us) server_negotiation.cc:407] Connection header received
0806 13:01:47.876658 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:47.876660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:47.876677 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:47.876735 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:47.878437 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:47.879507 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:47.881217 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:47.881658 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:47.881758 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:47.885222 (+ 3464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:47.885225 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:47.885225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:47.885240 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:47.887082 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:47.887936 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:47.887939 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:47.887939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:47.888043 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:47.888555 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:47.888556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:47.888557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:47.888789 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:47.888900 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:47.889532 (+ 632us) server_negotiation.cc:299] Negotiation successful
0806 13:01:47.889681 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 13:01:47.890529 27885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:47.875497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:47061)
0806 13:01:47.875747 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:47.875810 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:47.876495 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:47.876833 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:47.876837 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:47.877845 (+ 1008us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:47.878265 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:47.878277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:47.879638 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:47.879639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:47.881083 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:47.881088 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:47.881788 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:47.881790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:47.882005 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:47.882824 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:47.882837 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:47.885025 (+ 2188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:47.887254 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:47.887275 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:47.887279 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:47.887649 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:47.888193 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:47.888194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:47.888195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:47.888455 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:47.888886 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:47.888901 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:47.889312 (+ 411us) client_negotiation.cc:769] Sending connection context
0806 13:01:47.889489 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 13:01:47.889790 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":109,"threads_started":1}
I20260806 13:01:47.891515 27883 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38107
I20260806 13:01:47.891682 27883 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:47.891969 27883 heartbeater.cc:511] Master 127.20.245.190:38107 requested a full tablet report, sending...
I20260806 13:01:47.892982 27690 ts_manager.cc:194] Registered new tserver with Master: 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.130@KRBTEST.COM" created.
I20260806 13:01:47.893838 27690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:47061
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab.
Entry for principal oryx/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab.
I20260806 13:01:47.925364 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38107
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab
--principal=oryx/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:48.030176 27888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:48.030524 27888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:48.030558 27888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:48.032307 27888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:48.032402 27888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:48.032442 27888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:48.035670 27888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab
--principal=oryx/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:48.036322 27888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:48.036717 27888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:48.044453 27894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.044453 27896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.044466 27893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:48.045583 27888 server_base.cc:1034] running on GCE node
I20260806 13:01:48.045922 27888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:48.046285 27888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:48.047502 27888 hybrid_clock.cc:648] HybridClock initialized: now 1786021308047481 us; error 53 us; skew 500 ppm
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:48.051891 27888 init.cc:377] Logged in from keytab as oryx/127.20.245.130@KRBTEST.COM (short username oryx)
I20260806 13:01:48.052659 27888 webserver.cc:460] Webserver started at http://127.20.245.130:42109/ using document root <none> and password file <none>
I20260806 13:01:48.053020 27888 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:48.053108 27888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:48.053328 27888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:48.054819 27888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "1c0641dbd77c4b60b5eded7f96e69489"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "c28eae91c8e1824c11bd4912d055aea6"
server_key_iv: "33f9945eba8a5755903454720323a5b5"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.055421 27888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "1c0641dbd77c4b60b5eded7f96e69489"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "c28eae91c8e1824c11bd4912d055aea6"
server_key_iv: "33f9945eba8a5755903454720323a5b5"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.057569 27888 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 13:01:48.058967 27903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.059568 27888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260806 13:01:48.059834 27888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "1c0641dbd77c4b60b5eded7f96e69489"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "c28eae91c8e1824c11bd4912d055aea6"
server_key_iv: "33f9945eba8a5755903454720323a5b5"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.059973 27888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:48.084107 27888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:48.087790 27888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:48.088032 27888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:48.088392 27888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:48.088850 27888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:48.088913 27888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.088955 27888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:48.089003 27888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.096998 27888 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:45189
I20260806 13:01:48.097043 28017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:45189 every 8 connection(s)
I20260806 13:01:48.097540 27888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:48.104712 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 27888
I20260806 13:01:48.104879 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:48.105129 21462 external_mini_cluster.cc:1428] Setting key e8a484bbe2cba8663b976338fa7f848c
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:48.114857 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.098937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:34801 (local address 127.20.245.190:38107)
0806 13:01:48.099037 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.099056 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.099359 (+ 303us) server_negotiation.cc:407] Connection header received
0806 13:01:48.100142 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.100144 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.100161 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.100258 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.101747 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.102437 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.104751 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.105149 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.105410 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.109350 (+ 3940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.109354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.109354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.109371 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.111703 (+ 2332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.112598 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.112600 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.112600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.112699 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.113297 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.113298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.113298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.113504 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.113576 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.114262 (+ 686us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.114458 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 13:01:48.114940 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.098903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:34801)
0806 13:01:48.099129 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.099206 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.099940 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.100403 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.100409 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.101188 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.101525 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.101533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.102690 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.102692 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.104558 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.104564 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.105442 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.105444 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.105675 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.106664 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.106681 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.109152 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.111871 (+ 2719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.111894 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.111899 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.112438 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.112796 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.112797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.112797 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.113066 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.113596 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.113626 (+ 30us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.113927 (+ 301us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.114153 (+ 226us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.114525 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":123,"threads_started":1}
I20260806 13:01:48.115918 28018 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38107
I20260806 13:01:48.116335 28018 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:48.116860 28018 heartbeater.cc:511] Master 127.20.245.190:38107 requested a full tablet report, sending...
I20260806 13:01:48.117673 27690 ts_manager.cc:194] Registered new tserver with Master: 1c0641dbd77c4b60b5eded7f96e69489 (127.20.245.130:45189)
I20260806 13:01:48.118379 27690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:34801
WARNING: no policy specified for oryx/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab.
Entry for principal oryx/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab.
I20260806 13:01:48.145167 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38107
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab
--principal=oryx/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:48.265304 28023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:48.265638 28023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:48.265673 28023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:48.267452 28023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:48.267534 28023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:48.267575 28023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:48.269668 28023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab
--principal=oryx/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:38107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:48.270089 28023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:48.270452 28023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:48.277341 28031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.277362 28029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.277326 28028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:48.278136 28023 server_base.cc:1034] running on GCE node
I20260806 13:01:48.278556 28023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:48.278936 28023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:48.280118 28023 hybrid_clock.cc:648] HybridClock initialized: now 1786021308280083 us; error 56 us; skew 500 ppm
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:48.283869 28023 init.cc:377] Logged in from keytab as oryx/127.20.245.131@KRBTEST.COM (short username oryx)
I20260806 13:01:48.284549 28023 webserver.cc:460] Webserver started at http://127.20.245.131:38835/ using document root <none> and password file <none>
I20260806 13:01:48.284885 28023 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:48.284976 28023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:48.285164 28023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:48.286736 28023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "7be75db4c51146688de144b205567c3a"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "06ec2830b594dfad0d7cdee3d750f78e"
server_key_iv: "23409bebecd70c2f55bcbb540d9f3897"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.287386 28023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "7be75db4c51146688de144b205567c3a"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "06ec2830b594dfad0d7cdee3d750f78e"
server_key_iv: "23409bebecd70c2f55bcbb540d9f3897"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.289505 28023 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:01:48.290745 28039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.291070 28023 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:48.291318 28023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "7be75db4c51146688de144b205567c3a"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "06ec2830b594dfad0d7cdee3d750f78e"
server_key_iv: "23409bebecd70c2f55bcbb540d9f3897"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.291460 28023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:48.306907 28023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:48.310184 28023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:48.310420 28023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:48.310782 28023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:48.311318 28023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:48.311378 28023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.311429 28023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:48.311455 28023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.320770 28023 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:40389
I20260806 13:01:48.320837 28153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:40389 every 8 connection(s)
I20260806 13:01:48.321607 28023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:48.326387 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 28023
I20260806 13:01:48.326520 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:48.326804 21462 external_mini_cluster.cc:1428] Setting key 2cc6021a9fbef5872756f4c9fd7adda4
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:48.341112 28156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.322696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:37885)
0806 13:01:48.322943 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.323010 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.324014 (+ 1004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.326660 (+ 2646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.326670 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.327805 (+ 1135us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.328241 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.328259 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.329479 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.329481 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.330872 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.330881 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.331969 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.331970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.332208 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.333237 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.333251 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.335717 (+ 2466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.338406 (+ 2689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.338434 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.338438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.339062 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.339475 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.339477 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.339477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.339662 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.340280 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.340289 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.340497 (+ 208us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.340610 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.340848 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":105,"threads_started":1}
I20260806 13:01:48.341223 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.326033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:37885 (local address 127.20.245.190:38107)
0806 13:01:48.326254 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.326256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.326274 (+ 18us) server_negotiation.cc:407] Connection header received
0806 13:01:48.326318 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.326319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.326335 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.326434 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.328359 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.329192 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.331066 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.331751 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.331877 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.335975 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.335977 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.335978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.335991 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.338187 (+ 2196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.339293 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.339295 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.339296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.339404 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.339754 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.339755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.339756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.340034 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.340249 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.340772 (+ 523us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.340873 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260806 13:01:48.341859 28154 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38107
I20260806 13:01:48.341997 28154 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:48.342222 28154 heartbeater.cc:511] Master 127.20.245.190:38107 requested a full tablet report, sending...
I20260806 13:01:48.342739 27690 ts_manager.cc:194] Registered new tserver with Master: 7be75db4c51146688de144b205567c3a (127.20.245.131:40389)
I20260806 13:01:48.343218 27690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:37885
I20260806 13:01:48.351703 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.245.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.189.keytab.
Entry for principal oryx/127.20.245.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.189.keytab.
I20260806 13:01:48.392979 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.189:37783
--webserver_interface=127.20.245.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.189.keytab
--principal=oryx/127.20.245.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:38107,127.20.245.189:37783
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:48.500082 28159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:48.500458 28159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:48.500510 28159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:48.502187 28159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:48.502303 28159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:48.502331 28159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:48.502354 28159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:48.502384 28159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:48.504712 28159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:38107,127.20.245.189:37783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.189.keytab
--principal=oryx/127.20.245.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.189:37783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.245.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
W20260806 13:01:48.504969 28159 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.245.190:38107,127.20.245.189:37783'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 13:01:48.505211 28159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:48.505574 28159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:48.511756 28164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.511765 28165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.511996 28167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:48.512377 28159 server_base.cc:1034] running on GCE node
I20260806 13:01:48.512748 28159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:48.513190 28159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:48.514420 28159 hybrid_clock.cc:648] HybridClock initialized: now 1786021308514401 us; error 64 us; skew 500 ppm
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:48.518174 28159 init.cc:377] Logged in from keytab as oryx/127.20.245.189@KRBTEST.COM (short username oryx)
I20260806 13:01:48.518909 28159 webserver.cc:460] Webserver started at http://127.20.245.189:34611/ using document root <none> and password file <none>
I20260806 13:01:48.519266 28159 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:48.519351 28159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:48.519546 28159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:48.521164 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data/instance:
uuid: "a66875f0a60848dfb9277929dbee2046"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "6351e7d3fe308bdb3f63923d1eb85c04"
server_key_iv: "8dc1a8d18a2d1e165ee81fb47fc9b2be"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.521672 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal/instance:
uuid: "a66875f0a60848dfb9277929dbee2046"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "6351e7d3fe308bdb3f63923d1eb85c04"
server_key_iv: "8dc1a8d18a2d1e165ee81fb47fc9b2be"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.523727 28159 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260806 13:01:48.524967 28174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.525327 28159 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:48.525463 28159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
uuid: "a66875f0a60848dfb9277929dbee2046"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "6351e7d3fe308bdb3f63923d1eb85c04"
server_key_iv: "8dc1a8d18a2d1e165ee81fb47fc9b2be"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.525574 28159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:48.541155 28159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:48.544628 28159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:48.544902 28159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:48.550383 28159 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.189:37783
I20260806 13:01:48.550464 28228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.189:37783 every 8 connection(s)
I20260806 13:01:48.551007 28159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
I20260806 13:01:48.552412 28229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:48.554435 28229 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:01:48.561184 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 28159
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.189@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:48.568756 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.555677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52812 (local address 127.20.245.190:38107)
0806 13:01:48.555761 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.555764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.556174 (+ 410us) server_negotiation.cc:407] Connection header received
0806 13:01:48.556857 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.556859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.556873 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.556938 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.557879 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.558463 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.560009 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.560290 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.560362 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.564036 (+ 3674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.564039 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.564040 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.564051 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.566389 (+ 2338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.567268 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.567270 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.567270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.567344 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.567808 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.567809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.567809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.568038 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.568114 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.568503 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.568625 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.245.189@KRBTEST.COM
I20260806 13:01:48.568897 28231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.555647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:52812)
0806 13:01:48.556005 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.556057 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.556736 (+ 679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.557041 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.557045 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.557418 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.557759 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.557765 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.558624 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.558626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.559880 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.559884 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.560409 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.560411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.560556 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.561348 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.561384 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.563921 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.566526 (+ 2605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.566535 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.566537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.567039 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.567423 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.567425 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.567425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.567695 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.568130 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.568139 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.568329 (+ 190us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.568449 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.568633 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":199,"threads_started":1}
I20260806 13:01:48.569867 28229 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:01:48.573504 28233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.562006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43614 (local address 127.20.245.189:37783)
0806 13:01:48.562298 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.562307 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.562336 (+ 29us) server_negotiation.cc:407] Connection header received
0806 13:01:48.562367 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.562370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.562400 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.562495 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.563553 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.564683 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.565628 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.566031 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.566133 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.569556 (+ 3423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.569568 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.569569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.569583 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.571913 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.572357 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.572361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.572361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.572434 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.572749 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.572751 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.572751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.572922 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.573129 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.573248 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.573366 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":181,"threads_started":1}
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.189@KRBTEST.COM for oryx/127.20.245.189@KRBTEST.COM
I20260806 13:01:48.579005 28231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.570268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.0.0.1:43616)
0806 13:01:48.570333 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.570344 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.570390 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.570812 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.570813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.571013 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.571093 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.571095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.571913 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.571914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.572613 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.572615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.573079 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.573080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.573147 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.573760 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.573765 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.575218 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.577829 (+ 2611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.577830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.577830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.578019 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.578339 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.578340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.578341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.578408 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.578665 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.578665 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.578713 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.578774 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.578924 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":56}
I20260806 13:01:48.579005 28234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.570316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43616 (local address 127.20.245.189:37783)
0806 13:01:48.570623 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.570625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.570633 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:01:48.570686 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.570687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.570701 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.570797 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.571285 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.571825 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.572703 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.572929 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.573028 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.575305 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.575307 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.575308 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.575315 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.577711 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.578178 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.578180 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.578180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.578247 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.578476 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.578476 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.578476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.578605 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.578701 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.578792 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.578871 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":150,"threads_started":1}
I20260806 13:01:48.581519 28229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Bootstrap starting.
I20260806 13:01:48.582641 28229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:48.583063 28229 log.cc:824] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:48.584578 28229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: No bootstrap required, opened a new log
I20260806 13:01:48.586599 28229 raft_consensus.cc:348] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } }
I20260806 13:01:48.586833 28229 raft_consensus.cc:374] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:48.586867 28229 raft_consensus.cc:729] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a66875f0a60848dfb9277929dbee2046, State: Initialized, Role: FOLLOWER
I20260806 13:01:48.587255 28229 consensus_queue.cc:260] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } }
I20260806 13:01:48.587785 28236 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } } }
I20260806 13:01:48.587882 28229 sys_catalog.cc:564] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:48.587939 28236 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 13:01:48.590492 28247 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:01:48.590608 28247 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:01:48.593211 28159 master_runner.cc:428] Detected that this master a66875f0a60848dfb9277929dbee2046 is joining an existing cluster
I20260806 13:01:48.593340 28159 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.245.189:37783
I20260806 13:01:48.604044 28234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.594897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43624 (local address 127.20.245.189:37783)
0806 13:01:48.595220 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.595223 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.595552 (+ 329us) server_negotiation.cc:407] Connection header received
0806 13:01:48.595587 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.595588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.595607 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.595670 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.596118 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.596970 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.598847 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.599289 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.599364 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.600771 (+ 1407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.600773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.600773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.600780 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.602651 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.603062 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.603063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.603063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.603120 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.603375 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.603375 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.603376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.603553 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.603634 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.603849 (+ 215us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.603951 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260806 13:01:48.604403 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.594881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.0.0.1:43624)
0806 13:01:48.595461 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.595471 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.595541 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.595691 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.595692 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.595922 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.596033 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.596037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.597062 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.597063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.598142 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.598146 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.599434 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.599436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.599519 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.599909 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.599915 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.600673 (+ 758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.602751 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.602752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.602752 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.602981 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.603237 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.603238 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.603238 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.603299 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.603657 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.603658 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.603704 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.604135 (+ 431us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.604270 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":71,"thread_start_us":100,"threads_started":1}
I20260806 13:01:48.604588 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.595163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52816 (local address 127.20.245.190:38107)
0806 13:01:48.595257 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.595259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.595272 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:01:48.595309 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.595310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.595324 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.595393 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.596218 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.596796 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.598272 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.598670 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.598761 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.600781 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.600783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.600783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.600794 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.603098 (+ 2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.603628 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.603630 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.603630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.603713 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.603965 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.603966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.603966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.604137 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.604216 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.604399 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.604497 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 13:01:48.605011 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.594820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:52816)
0806 13:01:48.595060 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.595075 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.595158 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.595466 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.595468 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.595887 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.596077 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.596079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.596908 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.596910 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.598142 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.598146 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.598794 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.598795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.598852 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.599911 (+ 1059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.599918 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.600664 (+ 746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.603273 (+ 2609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.603274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.603274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.603525 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.603805 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.603806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.603807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.603870 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.604221 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.604222 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.604264 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.604790 (+ 526us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.604914 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":39,"thread_start_us":143,"threads_started":1}
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.190@KRBTEST.COM for oryx/127.20.245.189@KRBTEST.COM
I20260806 13:01:48.620241 28234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.609050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43638 (local address 127.20.245.189:37783)
0806 13:01:48.609128 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.609131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.609456 (+ 325us) server_negotiation.cc:407] Connection header received
0806 13:01:48.609555 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.609556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.609572 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.609659 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.610481 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.611360 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.612424 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.612763 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.612848 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.616497 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.616500 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.616501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.616511 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.618494 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.619160 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.619162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.619162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.619354 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.619590 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.619591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.619591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.619734 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.619803 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.620063 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.620153 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 13:01:48.620337 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.608945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.0.0.1:43638)
0806 13:01:48.609297 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.609360 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.609464 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.609667 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.609672 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.610242 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.610356 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.610362 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.611497 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.611502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.612311 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.612315 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.612879 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.612880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.612990 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.613939 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.613945 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.616340 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.618627 (+ 2287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.618646 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.618650 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.619062 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.619431 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.619432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.619432 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.619519 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.619813 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.619827 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.619914 (+ 87us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.620031 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.620222 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":275,"threads_started":1}
I20260806 13:01:48.621798 27690 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.245.189:37783: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a66875f0a60848dfb9277929dbee2046"
member_type: NON_VOTER
last_known_addr {
host: "127.20.245.189"
port: 37783
}
attrs {
promote: true
}
}
dest_uuid: "50ddcad9609d42f19b5fd95c712d5b71"
cas_config_opid_index: -1
I20260806 13:01:48.622326 27690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } }
I20260806 13:01:48.623368 28258 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a66875f0a60848dfb9277929dbee2046 (127.20.245.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } }
I20260806 13:01:48.623937 28202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:48.625790 28258 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.245.189:37783
I20260806 13:01:48.626194 28159 master.cc:537] Master@127.20.245.189:37783 shutting down...
I20260806 13:01:48.626623 28202 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Refusing update from remote peer 50ddcad9609d42f19b5fd95c712d5b71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 13:01:48.626086 28257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } }
I20260806 13:01:48.627667 28258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 13:01:48.628778 27677 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260806 13:01:48.629311 27677 consensus_peers.cc:487] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 -> Peer a66875f0a60848dfb9277929dbee2046 (127.20.245.189:37783): Couldn't send request to peer a66875f0a60848dfb9277929dbee2046. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 13:01:48.626880 28257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:48.634027 28159 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:48.634341 28159 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:48.634476 28159 tablet_replica.cc:330] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: stopping tablet replica
I20260806 13:01:48.639328 28159 master.cc:552] Master@127.20.245.189:37783 shutdown complete.
I20260806 13:01:48.639415 28159 master_runner.cc:305] Clearing existing system tablet
I20260806 13:01:48.639582 28159 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:48.639640 28159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:48.640795 28159 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
WARNING: no policy specified for oryx/127.20.245.188@KRBTEST.COM; defaulting to no policy
I20260806 13:01:48.641640 28263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.641841 28159 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:48.641916 28159 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:48.641945 28159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
uuid: "a66875f0a60848dfb9277929dbee2046"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "6351e7d3fe308bdb3f63923d1eb85c04"
server_key_iv: "8dc1a8d18a2d1e165ee81fb47fc9b2be"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.643302 28159 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Deleting tablet data with delete state TABLET_DATA_DELETED
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.188@KRBTEST.COM" created.
I20260806 13:01:48.646080 28159 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 13:01:48.646221 28159 log.cc:1196] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 13:01:48.646493 28159 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Deleting consensus metadata
I20260806 13:01:48.646643 28159 master_runner.cc:315] Copying system tablet from 127.20.245.190:38107
I20260806 13:01:48.647580 28159 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: tablet copy: Beginning tablet copy session from remote peer at address 127.20.245.190:38107
I20260806 13:01:48.658593 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.648253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52830 (local address 127.20.245.190:38107)
0806 13:01:48.648360 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.648363 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.648694 (+ 331us) server_negotiation.cc:407] Connection header received
0806 13:01:48.648781 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.648782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.648800 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.648876 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.649687 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.650681 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.652239 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.652647 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.652743 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.654580 (+ 1837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.654583 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.654583 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.654596 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.656861 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.657473 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.657476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.657476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.657574 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.657859 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.657860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.657861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.658056 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.658137 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.658357 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.658471 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 13:01:48.658922 28270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.648344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:52830)
0806 13:01:48.648555 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.648573 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.648685 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.648901 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.648902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.649189 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.649392 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.649400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.650832 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.650835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.652041 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.652049 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.652772 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.652773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.652879 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.653728 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.653736 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.654419 (+ 683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.657012 (+ 2593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.657015 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.657015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.657359 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.657675 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.657676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.657677 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.657769 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.658156 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.658158 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.658232 (+ 74us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.658303 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.658440 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":131,"threads_started":1}
I20260806 13:01:48.659693 27711 tablet_copy_service.cc:140] P 50ddcad9609d42f19b5fd95c712d5b71: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a66875f0a60848dfb9277929dbee2046 ({username='oryx', principal='oryx/127.20.245.189@KRBTEST.COM'} at 127.0.0.1:52830)
I20260806 13:01:48.659897 27711 tablet_copy_service.cc:161] P 50ddcad9609d42f19b5fd95c712d5b71: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a66875f0a60848dfb9277929dbee2046 at {username='oryx', principal='oryx/127.20.245.189@KRBTEST.COM'} at 127.0.0.1:52830: session id = a66875f0a60848dfb9277929dbee2046-00000000000000000000000000000000
I20260806 13:01:48.661118 27711 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 13:01:48.662209 28159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 13:01:48.664611 28159 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: tablet copy: Starting download of 0 data blocks...
I20260806 13:01:48.664851 28159 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: tablet copy: Starting download of 1 WAL segments...
I20260806 13:01:48.667629 28159 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 13:01:48.669764 27711 tablet_copy_service.cc:342] P 50ddcad9609d42f19b5fd95c712d5b71: Request end of tablet copy session a66875f0a60848dfb9277929dbee2046-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.245.189@KRBTEST.COM'} at 127.0.0.1:52830
I20260806 13:01:48.669886 27711 tablet_copy_service.cc:433] P 50ddcad9609d42f19b5fd95c712d5b71: ending tablet copy session a66875f0a60848dfb9277929dbee2046-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a66875f0a60848dfb9277929dbee2046
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.188.keytab.
Entry for principal oryx/127.20.245.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.188.keytab.
I20260806 13:01:48.672912 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.188:43417
--webserver_interface=127.20.245.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.188.keytab
--principal=oryx/127.20.245.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:38107,127.20.245.189:37783,127.20.245.188:43417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:01:48.675371 28159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:48.677444 28275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.677522 28272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:48.677717 28159 server_base.cc:1034] running on GCE node
W20260806 13:01:48.678007 28273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:48.678215 28159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:48.678449 28159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:48.679646 28159 hybrid_clock.cc:648] HybridClock initialized: now 1786021308679632 us; error 37 us; skew 500 ppm
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:48.681877 28159 init.cc:377] Logged in from keytab as oryx/127.20.245.189@KRBTEST.COM (short username oryx)
I20260806 13:01:48.682367 28159 webserver.cc:460] Webserver started at http://127.20.245.189:44001/ using document root <none> and password file <none>
I20260806 13:01:48.682545 28159 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:48.682588 28159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:48.683686 28159 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:48.684473 28282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.684638 28159 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:48.684691 28159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
uuid: "a66875f0a60848dfb9277929dbee2046"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "6351e7d3fe308bdb3f63923d1eb85c04"
server_key_iv: "8dc1a8d18a2d1e165ee81fb47fc9b2be"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.684780 28159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:48.698251 28159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:48.700737 28159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:48.705711 28159 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.189:37783
I20260806 13:01:48.706764 28159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
I20260806 13:01:48.707350 28337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.189:37783 every 8 connection(s)
I20260806 13:01:48.708647 28338 sys_catalog.cc:263] Verifying existing consensus state
I20260806 13:01:48.709275 28338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Bootstrap starting.
I20260806 13:01:48.713059 28338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:01:48.713419 28338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Bootstrap complete.
I20260806 13:01:48.713783 28338 raft_consensus.cc:348] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } }
I20260806 13:01:48.713913 28338 raft_consensus.cc:729] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a66875f0a60848dfb9277929dbee2046, State: Initialized, Role: LEARNER
I20260806 13:01:48.713966 28338 consensus_queue.cc:260] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } }
I20260806 13:01:48.714334 28338 sys_catalog.cc:564] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:48.714318 28341 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } }
I20260806 13:01:48.714629 28341 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: This master's current role is: LEARNER
I20260806 13:01:48.716559 28352 catalog_manager.cc:1259] Loaded cluster ID: dd3ce48949614c53ab5b831e38566709
I20260806 13:01:48.716951 28352 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: loading cluster ID for follower catalog manager: success
I20260806 13:01:48.717973 28352 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: acquiring CA information for follower catalog manager: success
I20260806 13:01:48.718338 28352 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 13:01:48.858433 28271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:48.858820 28271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:48.858861 28271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:48.860978 28271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:48.861130 28271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:48.861153 28271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:48.861171 28271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:48.861195 28271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:48.864285 28271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:38107,127.20.245.189:37783,127.20.245.188:43417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.188.keytab
--principal=oryx/127.20.245.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.188:43417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.245.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:48.864827 28271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:48.865407 28271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:48.872383 28360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.872395 28357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:48.872383 28358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:48.872825 28271 server_base.cc:1034] running on GCE node
I20260806 13:01:48.873283 28271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:48.873836 28271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:48.875064 28271 hybrid_clock.cc:648] HybridClock initialized: now 1786021308875047 us; error 58 us; skew 500 ppm
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:48.887300 28271 init.cc:377] Logged in from keytab as oryx/127.20.245.188@KRBTEST.COM (short username oryx)
I20260806 13:01:48.888051 28271 webserver.cc:460] Webserver started at http://127.20.245.188:45283/ using document root <none> and password file <none>
I20260806 13:01:48.888331 28271 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:48.888386 28271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:48.888513 28271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:48.890012 28271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data/instance:
uuid: "8b84109f18aa4ab0b5297db822a2685c"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "dc81f3dba4c1c2c12b7d9786d1c27bc3"
server_key_iv: "3e368b45c5f2537ed1a6a5ac97edc01b"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.890463 28271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal/instance:
uuid: "8b84109f18aa4ab0b5297db822a2685c"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "dc81f3dba4c1c2c12b7d9786d1c27bc3"
server_key_iv: "3e368b45c5f2537ed1a6a5ac97edc01b"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.892462 28271 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 13:01:48.893477 28367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:48.893728 28271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:48.893873 28271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
uuid: "8b84109f18aa4ab0b5297db822a2685c"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "dc81f3dba4c1c2c12b7d9786d1c27bc3"
server_key_iv: "3e368b45c5f2537ed1a6a5ac97edc01b"
server_key_version: "encryptionkey@0"
I20260806 13:01:48.893980 28271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:48.895368 27883 heartbeater.cc:503] Master 127.20.245.190:38107 was elected leader, sending a full tablet report...
I20260806 13:01:48.917827 28271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:48.921669 28271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:48.921928 28271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:48.931408 28271 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.188:43417
I20260806 13:01:48.931522 28421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.188:43417 every 8 connection(s)
I20260806 13:01:48.932072 28271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
I20260806 13:01:48.933492 28422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:48.935477 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 28271
I20260806 13:01:48.935637 28422 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.188@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.245.188@KRBTEST.COM
I20260806 13:01:48.949445 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.936828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52844 (local address 127.20.245.190:38107)
0806 13:01:48.936944 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.936947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.937170 (+ 223us) server_negotiation.cc:407] Connection header received
0806 13:01:48.938040 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.938043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.938062 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.938166 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.939040 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.939853 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.941165 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.941418 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.941523 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.944893 (+ 3370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.944897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.944898 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.944913 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.946922 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.947686 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.947687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.947688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.947818 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.948365 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.948366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.948366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.948610 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.948671 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.949190 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.949319 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 13:01:48.949663 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.936967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34160 (local address 127.20.245.188:43417)
0806 13:01:48.937140 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.937145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.937186 (+ 41us) server_negotiation.cc:407] Connection header received
0806 13:01:48.937834 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.937844 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.937873 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.938044 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.938811 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.940084 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.941092 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.941453 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.941674 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.945197 (+ 3523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.945207 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.945207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.945214 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.947689 (+ 2475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.948196 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.948200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.948201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.948267 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.948562 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.948563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.948564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.949018 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.949205 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.949430 (+ 225us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.949508 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":140,"thread_start_us":120,"threads_started":1}
I20260806 13:01:48.949682 28424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.936671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:52844)
0806 13:01:48.937002 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.937051 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.937871 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.938211 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.938219 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.938646 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.938913 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.938919 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.940057 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.940058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.941060 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.941063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.941564 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.941566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.941674 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.942442 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.942453 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.944733 (+ 2280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.947051 (+ 2318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.947059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.947063 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.947583 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.947986 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.947988 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.947988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.948212 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.948782 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.948788 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.949013 (+ 225us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.949133 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.949335 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":8,"thread_start_us":146,"threads_started":1}
I20260806 13:01:48.950551 28422 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.188@KRBTEST.COM for oryx/127.20.245.189@KRBTEST.COM
I20260806 13:01:48.960701 28424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.950979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.0.0.1:43640)
0806 13:01:48.951058 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.951073 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.951135 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.951482 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.951483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.951625 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.951689 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.951690 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.952626 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.952627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.953217 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.953220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.953790 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.953791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.954017 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.954776 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.954782 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.956722 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.959045 (+ 2323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.959047 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.959048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.959345 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.959601 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.959602 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.959603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.959678 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.960011 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.960012 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.960071 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.960373 (+ 302us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.960543 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 13:01:48.960722 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.951085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43640 (local address 127.20.245.189:37783)
0806 13:01:48.951312 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.951314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.951325 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:48.951362 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.951362 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.951377 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.951469 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.951771 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.952502 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.953348 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.953648 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.953731 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.956889 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.956891 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.956892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.956904 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.958887 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.959439 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.959441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.959442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.959518 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.959747 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.959748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.959748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.959929 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.960019 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.960417 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.960548 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":156,"threads_started":1}
I20260806 13:01:48.962461 28422 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:01:48 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021308, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.188@KRBTEST.COM for oryx/127.20.245.188@KRBTEST.COM
I20260806 13:01:48.973639 28424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.963376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.0.0.1:34166)
0806 13:01:48.963459 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.963481 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.963592 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.964275 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.964277 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.964602 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.964697 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.964701 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.965741 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.965742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.966328 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.966331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.966826 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.966828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.966889 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.967750 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:48.967756 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:48.969552 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:48.971989 (+ 2437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.971990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.971991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.972293 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.972558 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:48.972559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:48.972560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:48.972642 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:48.973022 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:48.973023 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:48.973073 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 13:01:48.973152 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 13:01:48.973453 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 13:01:48.973717 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.963433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.20.245.188:43417)
0806 13:01:48.963497 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.963500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.963671 (+ 171us) server_negotiation.cc:407] Connection header received
0806 13:01:48.963737 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.963739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.963760 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.964052 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.964881 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.965575 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.966443 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.966716 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.966796 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:48.969690 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:48.969692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:48.969693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:48.969705 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:48.971856 (+ 2151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.972392 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.972393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.972393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.972463 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:48.972734 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:48.972735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:48.972735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:48.972896 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:48.972967 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:48.973232 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 13:01:48.973582 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":246,"server-negotiator.queue_time_us":34}
I20260806 13:01:48.976485 28422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Bootstrap starting.
I20260806 13:01:48.978652 28422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:48.979305 28422 log.cc:824] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:48.980562 28422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: No bootstrap required, opened a new log
I20260806 13:01:48.984738 28422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } }
I20260806 13:01:48.985087 28422 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:48.985152 28422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b84109f18aa4ab0b5297db822a2685c, State: Initialized, Role: FOLLOWER
I20260806 13:01:48.985406 28422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } }
I20260806 13:01:48.985965 28428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } } }
I20260806 13:01:48.986054 28422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:48.986073 28428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: This master's current role is: FOLLOWER
W20260806 13:01:48.989810 28439 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:01:48.989938 28439 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:01:48.993846 28271 master_runner.cc:428] Detected that this master 8b84109f18aa4ab0b5297db822a2685c is joining an existing cluster
I20260806 13:01:48.993983 28271 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.245.188:43417
I20260806 13:01:49.001822 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 27753
I20260806 13:01:49.005442 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.995988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.0.0.1:34170)
0806 13:01:48.996689 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.996702 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.996791 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.996982 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.996983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.997484 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.997664 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.997666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.998713 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.998714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:48.999783 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.999788 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.000755 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.000756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.000845 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.001634 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.001641 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.002336 (+ 695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.004349 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.004350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.004350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.004581 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.004767 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.004767 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.004768 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.004822 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.005089 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.005089 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.005125 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.005178 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.005303 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":25,"thread_start_us":260,"threads_started":1}
I20260806 13:01:49.005913 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.996314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34170 (local address 127.20.245.188:43417)
0806 13:01:48.996375 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.996377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.996770 (+ 393us) server_negotiation.cc:407] Connection header received
0806 13:01:48.996847 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.996848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.996861 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.996922 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.997779 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.998608 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.999949 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.000517 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.000620 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.002427 (+ 1807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.002428 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.002429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.002436 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.004224 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.004648 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.004649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.004650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.004700 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.004875 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.004875 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.004876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.005018 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.005071 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.005674 (+ 603us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.005780 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":27}
I20260806 13:01:49.012439 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:44889
--local_ip_for_outbound_sockets=127.20.245.129
--tserver_master_addrs=127.20.245.190:38107
--webserver_port=35019
--webserver_interface=127.20.245.129
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab
--principal=oryx/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783,127.20.245.188:43417 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:01:49.017479 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.996264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.0.0.1:43642)
0806 13:01:48.996891 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.996901 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.996979 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.997238 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.997239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.997535 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.997655 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.997659 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.998714 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.998714 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.001131 (+ 2417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.001134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.001836 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.001837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.001956 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.012071 (+ 10115us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.012081 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.012727 (+ 646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.015953 (+ 3226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.015955 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.015956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.016243 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.016517 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.016518 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.016518 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.016588 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.016970 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.016971 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.017035 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.017112 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.017291 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":442,"threads_started":1}
I20260806 13:01:49.017921 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.996411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43642 (local address 127.20.245.189:37783)
0806 13:01:48.996468 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.996470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.996954 (+ 484us) server_negotiation.cc:407] Connection header received
0806 13:01:48.997074 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.997076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.997091 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.997126 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.997776 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.998596 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.001285 (+ 2689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.001685 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.001741 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.012879 (+ 11138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.012882 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.012882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.012896 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.015837 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.016363 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.016366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.016366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.016443 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.016664 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.016665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.016666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.016861 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.016935 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.017699 (+ 764us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.017825 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:01:49.020192 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.996962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52854 (local address 127.20.245.190:38107)
0806 13:01:48.997019 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:48.997021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:48.997539 (+ 518us) server_negotiation.cc:407] Connection header received
0806 13:01:48.997673 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:48.997675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:48.997692 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:48.997747 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:48.998801 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.999730 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.012554 (+ 12824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.012949 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.013013 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.015771 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.015775 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.015775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.015802 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.018445 (+ 2643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.018941 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.018943 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.018944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.019041 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.019410 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.019411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.019412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.019605 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.019662 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.019916 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.020044 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 13:01:49.020658 28448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:48.997155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:52854)
0806 13:01:48.997437 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:48.997448 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:48.997572 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:48.997873 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:48.997874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:48.998325 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:48.998663 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:48.998667 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:48.999933 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:48.999934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.012345 (+ 12411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.012359 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.013162 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.013163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.013269 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.014500 (+ 1231us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.014507 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.015607 (+ 1100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.018577 (+ 2970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.018578 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.018579 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.018842 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.019133 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.019133 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.019134 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.019326 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.019717 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.019718 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.019778 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.020363 (+ 585us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.020528 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":131,"threads_started":1}
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021307, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.190@KRBTEST.COM for oryx/127.20.245.188@KRBTEST.COM
I20260806 13:01:49.055610 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.023863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34174 (local address 127.20.245.188:43417)
0806 13:01:49.023932 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.023935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.023945 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:01:49.023997 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.023998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.024010 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.024076 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.024594 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.025431 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.026562 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.026875 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.026940 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.029915 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.029918 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.029919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.029930 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.053706 (+ 23776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.054495 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.054497 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.054498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.054590 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.054836 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.054837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.054837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.055014 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.055098 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.055362 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.055475 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 13:01:49.056319 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.023758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.0.0.1:34174)
0806 13:01:49.023827 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.023845 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.023906 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.024183 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.024185 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.024428 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.024501 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.024503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.025541 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.025543 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.026445 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.026450 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.027020 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.027022 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.027113 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.027796 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.027803 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.029758 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.053899 (+ 24141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.053903 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.053904 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.054367 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.054670 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.054671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.054672 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.054760 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.055091 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.055092 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.055168 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.055315 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.055522 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 13:01:49.057338 27690 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.245.188:43417: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c"
member_type: NON_VOTER
last_known_addr {
host: "127.20.245.188"
port: 43417
}
attrs {
promote: true
}
}
dest_uuid: "50ddcad9609d42f19b5fd95c712d5b71"
cas_config_opid_index: 5
I20260806 13:01:49.057739 27690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } }
I20260806 13:01:49.058441 28258 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.059944 28258 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.245.188:43417
I20260806 13:01:49.060051 28258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.060135 28258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:49.060688 28394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:49.062101 28394 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Refusing update from remote peer 50ddcad9609d42f19b5fd95c712d5b71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 13:01:49.062638 28271 master.cc:537] Master@127.20.245.188:43417 shutting down...
I20260806 13:01:49.062713 28257 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 13:01:49.063714 27674 consensus_peers.cc:487] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 -> Peer 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188:43417): Couldn't send request to peer 8b84109f18aa4ab0b5297db822a2685c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 13:01:49.066484 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.059299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43652 (local address 127.20.245.189:37783)
0806 13:01:49.059374 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.059377 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.059553 (+ 176us) server_negotiation.cc:407] Connection header received
0806 13:01:49.059675 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.059677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.059717 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.059765 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:49.060155 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.061070 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.065054 (+ 3984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.065805 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.065878 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.065964 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.066310 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.066376 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 13:01:49.066879 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.058376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.0.0.1:43652)
0806 13:01:49.059500 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.059515 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.059585 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.059875 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.059877 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.059880 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:49.059954 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.059956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.061667 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.061669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.064874 (+ 3205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.064883 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.066051 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.066053 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.066143 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.066210 (+ 67us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.066702 (+ 492us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.066794 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1103}
I20260806 13:01:49.067821 28310 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 LEARNER]: Refusing update from remote peer 50ddcad9609d42f19b5fd95c712d5b71: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 13:01:49.068022 28271 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:49.068159 28271 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:49.068229 28271 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: stopping tablet replica
I20260806 13:01:49.068188 28257 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 13:01:49.069087 28310 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.070842 28341 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50ddcad9609d42f19b5fd95c712d5b71. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.070968 28341 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: This master's current role is: LEARNER
I20260806 13:01:49.071010 28341 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: NON_VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: true } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.071050 28341 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: This master's current role is: LEARNER
I20260806 13:01:49.071919 28257 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: attempting to promote NON_VOTER a66875f0a60848dfb9277929dbee2046 to VOTER
I20260806 13:01:49.072252 28257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } }
I20260806 13:01:49.073338 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.073102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.0.0.1:34176)
0806 13:01:49.073188 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.073275 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 13:01:49.073719 28310 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 LEARNER]: Refusing update from remote peer 50ddcad9609d42f19b5fd95c712d5b71: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 13:01:49.074168 28258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 13:01:49.074347 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.074233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.0.0.1:34178)
0806 13:01:49.074279 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.074309 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260806 13:01:49.074777 27674 consensus_peers.cc:487] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 -> Peer 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188:43417): Couldn't send request to peer 8b84109f18aa4ab0b5297db822a2685c. Status: Network error: Client connection negotiation failed: client connection to 127.20.245.188:43417: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 13:01:49.075527 28310 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a66875f0a60848dfb9277929dbee2046 (127.20.245.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.076933 28451 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.077181 28451 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:01:49.075301 28452 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a66875f0a60848dfb9277929dbee2046 (127.20.245.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.078763 28257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.078889 28257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:49.078975 28257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.079026 28257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:49.083505 28271 master.cc:552] Master@127.20.245.188:43417 shutdown complete.
I20260806 13:01:49.083595 28271 master_runner.cc:305] Clearing existing system tablet
I20260806 13:01:49.083760 28271 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:49.083820 28271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:49.084823 28271 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:49.085940 28454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.086272 28271 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:49.086418 28271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:49.086469 28271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
uuid: "8b84109f18aa4ab0b5297db822a2685c"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "dc81f3dba4c1c2c12b7d9786d1c27bc3"
server_key_iv: "3e368b45c5f2537ed1a6a5ac97edc01b"
server_key_version: "encryptionkey@0"
I20260806 13:01:49.087810 28271 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:49.090453 28271 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 13:01:49.090801 28271 log.cc:1196] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 13:01:49.091389 28271 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Deleting consensus metadata
I20260806 13:01:49.091634 28271 master_runner.cc:315] Copying system tablet from 127.20.245.190:38107
I20260806 13:01:49.092648 28271 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: tablet copy: Beginning tablet copy session from remote peer at address 127.20.245.190:38107
I20260806 13:01:49.102712 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.093344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52862 (local address 127.20.245.190:38107)
0806 13:01:49.093414 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.093418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.093548 (+ 130us) server_negotiation.cc:407] Connection header received
0806 13:01:49.093627 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.093628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.093646 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.093751 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.094277 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.095328 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.096761 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.097084 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.097175 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.098773 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.098776 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.098776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.098787 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.101054 (+ 2267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.101701 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.101703 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.101704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.101781 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.102003 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.102004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.102004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.102180 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.102232 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.102468 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.102580 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 13:01:49.103705 28460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.093228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:52862)
0806 13:01:49.093428 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.093441 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.093548 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.093772 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.093773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.094088 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.094164 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.094167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.095475 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.095477 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.096609 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.096613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.097268 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.097270 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.097338 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.098048 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.098055 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.098615 (+ 560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.101279 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.101281 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.101282 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.101581 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.101862 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.101863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.101863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.101931 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.102285 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.102287 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.102347 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.103268 (+ 921us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.103567 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":106,"threads_started":1}
I20260806 13:01:49.104086 27711 tablet_copy_service.cc:140] P 50ddcad9609d42f19b5fd95c712d5b71: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8b84109f18aa4ab0b5297db822a2685c ({username='oryx', principal='oryx/127.20.245.188@KRBTEST.COM'} at 127.0.0.1:52862)
I20260806 13:01:49.104213 27711 tablet_copy_service.cc:161] P 50ddcad9609d42f19b5fd95c712d5b71: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8b84109f18aa4ab0b5297db822a2685c at {username='oryx', principal='oryx/127.20.245.188@KRBTEST.COM'} at 127.0.0.1:52862: session id = 8b84109f18aa4ab0b5297db822a2685c-00000000000000000000000000000000
I20260806 13:01:49.104843 27711 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 13:01:49.105593 28271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 13:01:49.107980 28271 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: tablet copy: Starting download of 0 data blocks...
I20260806 13:01:49.108280 28271 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: tablet copy: Starting download of 1 WAL segments...
I20260806 13:01:49.109499 28271 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 13:01:49.110924 27711 tablet_copy_service.cc:342] P 50ddcad9609d42f19b5fd95c712d5b71: Request end of tablet copy session 8b84109f18aa4ab0b5297db822a2685c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.245.188@KRBTEST.COM'} at 127.0.0.1:52862
I20260806 13:01:49.111009 27711 tablet_copy_service.cc:433] P 50ddcad9609d42f19b5fd95c712d5b71: ending tablet copy session 8b84109f18aa4ab0b5297db822a2685c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8b84109f18aa4ab0b5297db822a2685c
I20260806 13:01:49.115406 28271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:49.117187 28461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:49.117321 28464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:49.117708 28271 server_base.cc:1034] running on GCE node
W20260806 13:01:49.117726 28462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:49.118109 28271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:49.118356 28271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:49.119513 28271 hybrid_clock.cc:648] HybridClock initialized: now 1786021309119482 us; error 50 us; skew 500 ppm
I20260806 13:01:49.120334 28018 heartbeater.cc:503] Master 127.20.245.190:38107 was elected leader, sending a full tablet report...
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:49.121652 28271 init.cc:377] Logged in from keytab as oryx/127.20.245.188@KRBTEST.COM (short username oryx)
I20260806 13:01:49.122037 28271 webserver.cc:460] Webserver started at http://127.20.245.188:42445/ using document root <none> and password file <none>
I20260806 13:01:49.122179 28271 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:49.122233 28271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:49.123333 28271 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:49.124161 28471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.124382 28271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:49.124446 28271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
uuid: "8b84109f18aa4ab0b5297db822a2685c"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "dc81f3dba4c1c2c12b7d9786d1c27bc3"
server_key_iv: "3e368b45c5f2537ed1a6a5ac97edc01b"
server_key_version: "encryptionkey@0"
I20260806 13:01:49.124536 28271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:49.138621 28271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:49.141463 28271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:49.145673 28271 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.188:43417
I20260806 13:01:49.146162 28524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.188:43417 every 8 connection(s)
I20260806 13:01:49.146231 28271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
I20260806 13:01:49.147657 28525 sys_catalog.cc:263] Verifying existing consensus state
I20260806 13:01:49.148372 28525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Bootstrap starting.
W20260806 13:01:49.151392 28449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:49.151670 28449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:49.151729 28449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260806 13:01:49.152586 28525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:01:49.152887 28525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: Bootstrap complete.
I20260806 13:01:49.153265 28525 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } }
I20260806 13:01:49.153402 28525 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8b84109f18aa4ab0b5297db822a2685c, State: Initialized, Role: LEARNER
I20260806 13:01:49.153452 28525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } }
I20260806 13:01:49.153723 28525 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: configured and running, proceeding with master startup.
W20260806 13:01:49.153725 28449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:49.153790 28449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:49.153857 28449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:49.153733 28531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.154073 28531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: This master's current role is: LEARNER
I20260806 13:01:49.156885 28542 catalog_manager.cc:1259] Loaded cluster ID: dd3ce48949614c53ab5b831e38566709
I20260806 13:01:49.156963 28542 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: loading cluster ID for follower catalog manager: success
I20260806 13:01:49.157174 28449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab
--principal=oryx/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:44889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=35019
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783,127.20.245.188:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:49.157552 28449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:49.157887 28449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:01:49.158159 28542 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: acquiring CA information for follower catalog manager: success
I20260806 13:01:49.158541 28542 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 13:01:49.165876 28548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:49.165918 28546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:49.165884 28545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:49.166751 28449 server_base.cc:1034] running on GCE node
I20260806 13:01:49.167130 28449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:49.167587 28449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:49.168823 28449 hybrid_clock.cc:648] HybridClock initialized: now 1786021309168788 us; error 49 us; skew 500 ppm
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:49.172878 28449 init.cc:377] Logged in from keytab as oryx/127.20.245.129@KRBTEST.COM (short username oryx)
I20260806 13:01:49.173763 28449 webserver.cc:460] Webserver started at http://127.20.245.129:35019/ using document root <none> and password file <none>
I20260806 13:01:49.174178 28449 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:49.174324 28449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:49.176923 28449 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:49.178107 28555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.178314 28449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:49.178440 28449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "2e3b447560a046c58c1b59fcbf4d6bbc"
format_stamp: "Formatted at 2026-08-06 13:01:47 on dist-test-slave-srgv"
server_key: "cba3e693f883e40f7edf8a406d854c36"
server_key_iv: "ff518c74d18100c10c0e66d3327f0db5"
server_key_version: "encryptionkey@0"
I20260806 13:01:49.178929 28449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:49.190109 28449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:49.193698 28449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:49.194038 28449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:49.194489 28449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:49.195128 28449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:49.195262 28449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.195320 28449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:49.195341 28449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.207805 28449 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:44889
I20260806 13:01:49.207836 28670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:44889 every 8 connection(s)
I20260806 13:01:49.208433 28449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:49.215662 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 28449
I20260806 13:01:49.215976 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 27888
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.189@KRBTEST.COM
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.188@KRBTEST.COM
I20260806 13:01:49.228225 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:45189
--local_ip_for_outbound_sockets=127.20.245.130
--tserver_master_addrs=127.20.245.190:38107
--webserver_port=42109
--webserver_interface=127.20.245.130
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab
--principal=oryx/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783,127.20.245.188:43417 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:01:49.228359 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.209715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:59487 (local address 127.20.245.190:38107)
0806 13:01:49.209788 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.209791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.210836 (+ 1045us) server_negotiation.cc:407] Connection header received
0806 13:01:49.212573 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.212576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.212600 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.212642 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.214268 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.215157 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.217560 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.217925 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.217981 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.222482 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.222485 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.222486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.222501 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.225717 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.226841 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.226844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.226844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.226953 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.227331 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.227332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.227333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.227518 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.227571 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.228080 (+ 509us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.228223 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 13:01:49.228478 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.210357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:36931 (local address 127.20.245.189:37783)
0806 13:01:49.210442 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.210444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.210873 (+ 429us) server_negotiation.cc:407] Connection header received
0806 13:01:49.212583 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.212586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.212605 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.212642 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.214287 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.215223 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.220096 (+ 4873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.220612 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.220680 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.223776 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.223779 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.223780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.223792 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.225880 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.226587 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.226589 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.226590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.226672 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.227014 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.227015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.227016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.227491 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.227569 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.228072 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.228331 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 13:01:49.229212 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.209822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.20.245.129:36931)
0806 13:01:49.210561 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.210663 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.212395 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.212917 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.212923 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.213623 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.214094 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.214106 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.218992 (+ 4886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.218993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.219935 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.219941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.220797 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.220798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.220900 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.221711 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.221719 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.223619 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.226046 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.226047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.226048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.226473 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.226750 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.226750 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.226751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.226938 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.227611 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.227622 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.227872 (+ 250us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.228621 (+ 749us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.228906 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":96,"thread_start_us":246,"threads_started":1}
I20260806 13:01:49.229274 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.209829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:59487)
0806 13:01:49.210640 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.210663 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.212394 (+ 1731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.212917 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.212923 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.213584 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.214094 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.214106 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.215488 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.215489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.217404 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.217410 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.218118 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.218119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.218376 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.219352 (+ 976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.219368 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.222268 (+ 2900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.225860 (+ 3592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.225887 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.225893 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.226698 (+ 805us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.227045 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.227046 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.227046 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.227108 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.227625 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.227625 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.227872 (+ 247us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.228503 (+ 631us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.228813 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"mutex_wait_us":16,"thread_start_us":244,"threads_started":1}
I20260806 13:01:49.229972 28673 heartbeater.cc:347] Connected to a master server at 127.20.245.189:37783
I20260806 13:01:49.230121 28673 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.230253 28672 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38107
I20260806 13:01:49.230340 28672 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.230422 28673 heartbeater.cc:511] Master 127.20.245.189:37783 requested a full tablet report, sending...
I20260806 13:01:49.230472 28672 heartbeater.cc:511] Master 127.20.245.190:38107 requested a full tablet report, sending...
I20260806 13:01:49.230809 28678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.210186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.20.245.129:35075)
0806 13:01:49.211338 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.211353 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.212412 (+ 1059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.214748 (+ 2336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.214750 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.215166 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.215299 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.215301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.218117 (+ 2816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.218119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.219999 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.220004 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.220804 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.220805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.220971 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.222222 (+ 1251us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.222228 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.224812 (+ 2584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.227663 (+ 2851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.227663 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.227664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.227880 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.228122 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.228123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.228123 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.228188 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.230114 (+ 1926us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.230115 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.230219 (+ 104us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.230289 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.230664 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1121,"thread_start_us":272,"threads_started":1}
I20260806 13:01:49.231043 27690 ts_manager.cc:194] Re-registered known tserver with Master: 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889)
I20260806 13:01:49.231225 28299 ts_manager.cc:194] Registered new tserver with Master: 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889)
I20260806 13:01:49.231614 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.210337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:35075 (local address 127.20.245.188:43417)
0806 13:01:49.211529 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.211531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.211543 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:49.214546 (+ 3003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.214547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.214569 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.214675 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.215457 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.217975 (+ 2518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.220150 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.220629 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.220724 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.224950 (+ 4226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.224955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.224956 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.224970 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.227550 (+ 2580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.227974 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.227975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.227976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.228050 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.228256 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.228258 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.228258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.229224 (+ 966us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.230039 (+ 815us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.231343 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.231496 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1165,"thread_start_us":86,"threads_started":1}
I20260806 13:01:49.231792 27690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:59487
I20260806 13:01:49.233018 28671 heartbeater.cc:347] Connected to a master server at 127.20.245.188:43417
I20260806 13:01:49.233089 28671 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.233171 28671 heartbeater.cc:511] Master 127.20.245.188:43417 requested a full tablet report, sending...
I20260806 13:01:49.233848 28488 ts_manager.cc:194] Registered new tserver with Master: 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889)
W20260806 13:01:49.339099 28679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:49.339498 28679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:49.339545 28679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:49.340984 28679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:49.341094 28679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:49.341146 28679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:49.343149 28679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab
--principal=oryx/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:45189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=42109
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783,127.20.245.188:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:49.343617 28679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:49.343972 28679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:01:49.344473 28154 heartbeater.cc:503] Master 127.20.245.190:38107 was elected leader, sending a full tablet report...
W20260806 13:01:49.351099 28684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:49.351228 28679 server_base.cc:1034] running on GCE node
W20260806 13:01:49.351086 28685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:49.351086 28688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:49.351866 28679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:49.352239 28679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:49.353451 28679 hybrid_clock.cc:648] HybridClock initialized: now 1786021309353441 us; error 54 us; skew 500 ppm
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:49.357009 28679 init.cc:377] Logged in from keytab as oryx/127.20.245.130@KRBTEST.COM (short username oryx)
I20260806 13:01:49.357630 28679 webserver.cc:460] Webserver started at http://127.20.245.130:42109/ using document root <none> and password file <none>
I20260806 13:01:49.357934 28679 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:49.358043 28679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:49.359877 28679 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:01:49.360626 28695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.360831 28679 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:49.360958 28679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "1c0641dbd77c4b60b5eded7f96e69489"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "c28eae91c8e1824c11bd4912d055aea6"
server_key_iv: "33f9945eba8a5755903454720323a5b5"
server_key_version: "encryptionkey@0"
I20260806 13:01:49.361438 28679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:49.378034 28679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:49.381584 28679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:49.381857 28679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:49.382328 28679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:49.382905 28679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:49.382985 28679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.383044 28679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:49.383075 28679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.392179 28679 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:45189
I20260806 13:01:49.392306 28808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:45189 every 8 connection(s)
I20260806 13:01:49.392813 28679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:49.402659 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 28679
I20260806 13:01:49.402845 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 28023
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.189@KRBTEST.COM
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.188@KRBTEST.COM
I20260806 13:01:49.409914 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.393967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:33301 (local address 127.20.245.188:43417)
0806 13:01:49.394033 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.394036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.394683 (+ 647us) server_negotiation.cc:407] Connection header received
0806 13:01:49.396471 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.396472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.396494 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.396556 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.398364 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.399371 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.400592 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.400921 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.400984 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.405278 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.405280 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.405281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.405293 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.407531 (+ 2238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.408147 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.408149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.408149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.408291 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.408927 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.408929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.408929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.409094 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.409180 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.409585 (+ 405us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.409781 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 13:01:49.410043 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.394142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:52663 (local address 127.20.245.190:38107)
0806 13:01:49.394304 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.394307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.394714 (+ 407us) server_negotiation.cc:407] Connection header received
0806 13:01:49.396354 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.396357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.396383 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.396413 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.397553 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.398151 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.399768 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.400096 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.400163 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.404921 (+ 4758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.404926 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.404926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.404940 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.407318 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.408157 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.408159 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.408159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.408245 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.408823 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.408825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.408826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.409076 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.409152 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.409747 (+ 595us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.409873 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260806 13:01:49.410151 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.393889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.20.245.130:33301)
0806 13:01:49.394456 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.394582 (+ 126us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.396153 (+ 1571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.396610 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.396611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.397082 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.397390 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.397399 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.399475 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.399476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.400459 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.400475 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.401008 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.401010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.401142 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.401614 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.401623 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.405105 (+ 3482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.407713 (+ 2608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.407714 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.407715 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.408030 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.408389 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.408390 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.408391 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.408671 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.409218 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.409219 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.409411 (+ 192us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.409561 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.409809 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"mutex_wait_us":3,"thread_start_us":524,"threads_started":1}
I20260806 13:01:49.410939 28809 heartbeater.cc:347] Connected to a master server at 127.20.245.188:43417
I20260806 13:01:49.411051 28809 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.411099 28815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.393889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:52663)
0806 13:01:49.394581 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.394592 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.396150 (+ 1558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.396495 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.396500 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.397084 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.397390 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.397399 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.398322 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.398323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.399624 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.399626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.400231 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.400233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.400400 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.401379 (+ 979us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.401407 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.404684 (+ 3277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.407473 (+ 2789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.407497 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.407502 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.408043 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.408333 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.408334 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.408334 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.408689 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.409195 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.409207 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.409411 (+ 204us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.410209 (+ 798us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.410638 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":88,"thread_start_us":267,"threads_started":1}
I20260806 13:01:49.411355 28809 heartbeater.cc:511] Master 127.20.245.188:43417 requested a full tablet report, sending...
I20260806 13:01:49.411772 28810 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38107
I20260806 13:01:49.411824 28810 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.411901 28810 heartbeater.cc:511] Master 127.20.245.190:38107 requested a full tablet report, sending...
I20260806 13:01:49.412092 28488 ts_manager.cc:194] Registered new tserver with Master: 1c0641dbd77c4b60b5eded7f96e69489 (127.20.245.130:45189)
I20260806 13:01:49.412212 27690 ts_manager.cc:194] Re-registered known tserver with Master: 1c0641dbd77c4b60b5eded7f96e69489 (127.20.245.130:45189)
I20260806 13:01:49.412931 27690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:52663
I20260806 13:01:49.418666 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:40389
--local_ip_for_outbound_sockets=127.20.245.131
--tserver_master_addrs=127.20.245.190:38107
--webserver_port=38835
--webserver_interface=127.20.245.131
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab
--principal=oryx/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783,127.20.245.188:43417 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:01:49.420603 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.393889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.20.245.130:45275)
0806 13:01:49.394455 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.394530 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.396117 (+ 1587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.396493 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.396501 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.397016 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.397392 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.397405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.398358 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.398359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.399619 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.399622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.400247 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.400249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.400491 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.401460 (+ 969us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.401465 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.416330 (+ 14865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.419037 (+ 2707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.419038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.419039 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.419385 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.419684 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.419685 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.419685 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.419789 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.420154 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.420155 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.420270 (+ 115us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.420331 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.420480 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":3,"thread_start_us":129,"threads_started":1}
I20260806 13:01:49.420673 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.394300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:45275 (local address 127.20.245.189:37783)
0806 13:01:49.394380 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.394383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.394743 (+ 360us) server_negotiation.cc:407] Connection header received
0806 13:01:49.396296 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.396298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.396321 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.396381 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.397580 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.398138 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.399720 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.400061 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.400146 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.416476 (+ 16330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.416480 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.416480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.416497 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.418877 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.419506 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.419508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.419509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.419600 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.419877 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.419878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.419878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.420075 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.420151 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.420407 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.420523 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 13:01:49.421406 28811 heartbeater.cc:347] Connected to a master server at 127.20.245.189:37783
I20260806 13:01:49.421491 28811 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.421655 28811 heartbeater.cc:511] Master 127.20.245.189:37783 requested a full tablet report, sending...
I20260806 13:01:49.422080 28299 ts_manager.cc:194] Registered new tserver with Master: 1c0641dbd77c4b60b5eded7f96e69489 (127.20.245.130:45189)
W20260806 13:01:49.524318 28816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:49.524710 28816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:49.524770 28816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:49.526662 28816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:49.526789 28816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:49.526855 28816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:49.529114 28816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab
--principal=oryx/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:40389
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=38835
--tserver_master_addrs=127.20.245.190:38107,127.20.245.189:37783,127.20.245.188:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:49.529512 28816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:49.529860 28816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:49.536811 28821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:49.536818 28822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:49.536808 28824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:49.537464 28816 server_base.cc:1034] running on GCE node
I20260806 13:01:49.537810 28816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:49.538344 28816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:49.539570 28816 hybrid_clock.cc:648] HybridClock initialized: now 1786021309539545 us; error 62 us; skew 500 ppm
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:49.543874 28816 init.cc:377] Logged in from keytab as oryx/127.20.245.131@KRBTEST.COM (short username oryx)
I20260806 13:01:49.544596 28816 webserver.cc:460] Webserver started at http://127.20.245.131:38835/ using document root <none> and password file <none>
I20260806 13:01:49.544919 28816 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:49.545032 28816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:49.547145 28816 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:01:49.548439 28832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.548794 28816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:49.548954 28816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "7be75db4c51146688de144b205567c3a"
format_stamp: "Formatted at 2026-08-06 13:01:48 on dist-test-slave-srgv"
server_key: "06ec2830b594dfad0d7cdee3d750f78e"
server_key_iv: "23409bebecd70c2f55bcbb540d9f3897"
server_key_version: "encryptionkey@0"
I20260806 13:01:49.549552 28816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:49.571746 28816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:49.575313 28816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:49.575567 28816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:49.576015 28816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:49.576460 28816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:49.576499 28816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.576547 28816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:49.576573 28816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:49.584743 28816 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:40389
I20260806 13:01:49.584784 28947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:40389 every 8 connection(s)
I20260806 13:01:49.585310 28816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:49.587967 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 28816
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.189@KRBTEST.COM
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.188@KRBTEST.COM
Aug 06 13:01:49 dist-test-slave-srgv krb5kdc[27645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021309, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:49.601310 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.589309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34186 (local address 127.20.245.188:43417)
0806 13:01:49.589883 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.589885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.589893 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:01:49.589925 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.589926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.589938 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.590010 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.591494 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.592242 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.593301 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.593605 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.593672 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.597066 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.597068 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.597069 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.597079 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.599609 (+ 2530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.600097 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.600098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.600099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.600154 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.600381 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.600381 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.600382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.600481 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.600592 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.601062 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.601184 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":551,"thread_start_us":74,"threads_started":1}
I20260806 13:01:49.601604 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.586396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:48593 (local address 127.20.245.188:43417)
0806 13:01:49.586496 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.586499 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.586873 (+ 374us) server_negotiation.cc:407] Connection header received
0806 13:01:49.588744 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.588746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.588763 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.588840 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.589510 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.590257 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.591995 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.592323 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.592368 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.597453 (+ 5085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.597455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.597455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.597465 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.599418 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.599873 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.599874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.599874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.599940 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.600285 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.600286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.600287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.600477 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.600543 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.601061 (+ 518us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.601524 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":352,"server-negotiator.queue_time_us":57}
I20260806 13:01:49.601720 28952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.586333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.20.245.131:48593)
0806 13:01:49.586805 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.586815 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.588151 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.588906 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.588907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.589127 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.589392 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.589400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.590410 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.590411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.591903 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.591905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.592465 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.592466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.592624 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.593726 (+ 1102us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.593731 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.597327 (+ 3596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.599517 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.599518 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.599518 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.599771 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.600015 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.600015 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.600016 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.600203 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.600585 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.600594 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.600851 (+ 257us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.601138 (+ 287us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.601367 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":75,"thread_start_us":108,"threads_started":1}
I20260806 13:01:49.601805 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.586333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:56651)
0806 13:01:49.586592 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.586644 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.588261 (+ 1617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.588494 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.588500 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.589623 (+ 1123us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.589721 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.589724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.590777 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.590778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.591898 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.591901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.592469 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.592470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.592624 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.593420 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.593433 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.597995 (+ 4562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.600316 (+ 2321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.600316 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.600317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.600552 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.600833 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.600834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.600834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.600900 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.601224 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.601225 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.601273 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.601333 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.601457 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":26,"thread_start_us":107,"threads_started":1}
I20260806 13:01:49.602188 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.586323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:56651 (local address 127.20.245.190:38107)
0806 13:01:49.586495 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.586498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.586748 (+ 250us) server_negotiation.cc:407] Connection header received
0806 13:01:49.588360 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.588362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.588381 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.588415 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.589829 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.590658 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.592000 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.592329 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.592374 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.598164 (+ 5790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.598166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.598167 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.598179 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.600198 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.600669 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.600670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.600671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.600744 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.600973 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.600974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.600975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.601127 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.601191 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.601992 (+ 801us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.602096 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260806 13:01:49.602269 28948 heartbeater.cc:347] Connected to a master server at 127.20.245.188:43417
I20260806 13:01:49.602396 28948 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.602674 28948 heartbeater.cc:511] Master 127.20.245.188:43417 requested a full tablet report, sending...
I20260806 13:01:49.603117 28949 heartbeater.cc:347] Connected to a master server at 127.20.245.190:38107
I20260806 13:01:49.603230 28949 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.603276 28488 ts_manager.cc:194] Registered new tserver with Master: 7be75db4c51146688de144b205567c3a (127.20.245.131:40389)
I20260806 13:01:49.603322 28949 heartbeater.cc:511] Master 127.20.245.190:38107 requested a full tablet report, sending...
I20260806 13:01:49.603593 27690 ts_manager.cc:194] Re-registered known tserver with Master: 7be75db4c51146688de144b205567c3a (127.20.245.131:40389)
I20260806 13:01:49.603992 27690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:56651
I20260806 13:01:49.604159 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.586824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:54801 (local address 127.20.245.189:37783)
0806 13:01:49.586877 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.586879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.586890 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:49.588280 (+ 1390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.588281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.588300 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.588385 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.590549 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.591362 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.592344 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.592637 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.592680 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.595965 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.595966 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.595967 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.595976 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.598152 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.598843 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.598845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.598846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.598923 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.603047 (+ 4124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.603049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.603049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.603317 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.603408 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.603935 (+ 527us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.604048 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 13:01:49.604738 28954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.586680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.20.245.131:54801)
0806 13:01:49.586817 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.586830 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.588151 (+ 1321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.588494 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.588500 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.589018 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:49.589392 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.589400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.591464 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.591465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.592248 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.592250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.592766 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.592766 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.592832 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.593576 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:49.593582 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:49.595848 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:49.598264 (+ 2416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.598282 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.598286 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.598730 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.599010 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:49.599011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:49.599012 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:49.602922 (+ 3910us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:49.603699 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:49.603700 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:49.603754 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.603872 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.604099 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":9,"thread_start_us":98,"threads_started":1}
I20260806 13:01:49.605216 28950 heartbeater.cc:347] Connected to a master server at 127.20.245.189:37783
I20260806 13:01:49.605279 28950 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:49.605365 28950 heartbeater.cc:511] Master 127.20.245.189:37783 requested a full tablet report, sending...
I20260806 13:01:49.605718 28299 ts_manager.cc:194] Registered new tserver with Master: 7be75db4c51146688de144b205567c3a (127.20.245.131:40389)
I20260806 13:01:49.611843 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.589308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43668 (local address 127.20.245.189:37783)
0806 13:01:49.589820 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.589822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.590141 (+ 319us) server_negotiation.cc:407] Connection header received
0806 13:01:49.590249 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.590249 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.590265 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.590322 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.594048 (+ 3726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.594749 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.605098 (+ 10349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.605512 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.605599 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.607963 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.607966 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.607966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.607977 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.610098 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.610737 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.610738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.610771 (+ 33us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.610869 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.611055 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.611056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.611056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.611338 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.611446 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.611610 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.611708 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":68,"threads_started":1}
I20260806 13:01:49.612453 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.593199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52878 (local address 127.20.245.190:38107)
0806 13:01:49.593727 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.593729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.597745 (+ 4016us) server_negotiation.cc:407] Connection header received
0806 13:01:49.597790 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.597792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.597813 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.597903 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.603126 (+ 5223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.604589 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.605973 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.606284 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.606370 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.607989 (+ 1619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.607992 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.607992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.608001 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.609940 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.610529 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.610531 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.610531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.610631 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.610931 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.610932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.610932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.611136 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.611368 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.612160 (+ 792us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.612344 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":75,"threads_started":1}
I20260806 13:01:49.614794 27690 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:49.617594 27690 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:49.629216 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.624950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34190 (local address 127.20.245.188:43417)
0806 13:01:49.625015 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.625018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.625367 (+ 349us) server_negotiation.cc:407] Connection header received
0806 13:01:49.625521 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.625522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.625564 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.625648 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:49.625957 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.626759 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.627977 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.628643 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.628710 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.628833 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.629049 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.629105 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 13:01:49.629652 28971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.624678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.0.0.1:34190)
0806 13:01:49.625061 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.625075 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.625415 (+ 340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.625728 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.625733 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.625737 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:49.625838 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.625841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.626848 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.626849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.627857 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.627859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.628899 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.628899 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.628972 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.628976 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.629371 (+ 395us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.629448 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":210,"threads_started":1}
I20260806 13:01:49.630105 28499 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260806 13:01:49.631309 28972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.624696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:44889 (local address 127.0.0.1:38146)
0806 13:01:49.625123 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.625133 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.625425 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.626204 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.626205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.626209 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:49.626331 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.626334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.627709 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.627711 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.629215 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.629219 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.630992 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.630993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.631064 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.631070 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.631132 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.631202 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":360,"threads_started":1}
I20260806 13:01:49.631858 28531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50ddcad9609d42f19b5fd95c712d5b71. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.632009 28531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: This master's current role is: LEARNER
I20260806 13:01:49.632400 28973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.625006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38146 (local address 127.20.245.129:44889)
0806 13:01:49.625390 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.625398 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.625414 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:01:49.625950 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.625954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.625978 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.626101 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:49.626431 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.627542 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.629337 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.630700 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.630873 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.630953 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.632139 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.632213 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":200,"threads_started":1}
I20260806 13:01:49.633013 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.625672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:40389 (local address 127.0.0.1:49998)
0806 13:01:49.626459 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.626469 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.626520 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.628545 (+ 2025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.628546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.628548 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:49.628656 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.628658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.630130 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.630132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.631369 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.631372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.632613 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.632614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.632756 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.632762 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.632834 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.632888 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":2,"thread_start_us":152,"threads_started":1}
I20260806 13:01:49.633050 28977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.626260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49998 (local address 127.20.245.131:40389)
0806 13:01:49.628061 (+ 1801us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.628066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.628078 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:49.628298 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.628303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.628331 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.628442 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:49.628747 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.630027 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.631478 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.632339 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.632513 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.632611 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.632877 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.632939 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1737,"thread_start_us":119,"threads_started":1}
I20260806 13:01:49.633436 28974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.625440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45189 (local address 127.0.0.1:38306)
0806 13:01:49.625870 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.625881 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.625937 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.627837 (+ 1900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.627838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.627841 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:49.627909 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.627911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.630450 (+ 2539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.630452 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.632092 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.632096 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.633173 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.633175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.633260 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.633265 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.633296 (+ 31us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.633345 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":125,"threads_started":1}
I20260806 13:01:49.633901 28976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.626006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38306 (local address 127.20.245.130:45189)
0806 13:01:49.627534 (+ 1528us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.627542 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.627560 (+ 18us) server_negotiation.cc:407] Connection header received
0806 13:01:49.627653 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.627657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.627679 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.627833 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:49.628011 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.630346 (+ 2335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.632226 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.633055 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.633677 (+ 622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.633758 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.633786 (+ 28us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.633828 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1452,"thread_start_us":105,"threads_started":1}
I20260806 13:01:49.633646 28603 tablet_service.cc:1467] Processing CreateTablet for tablet 775a2100a9db4b488a8ef2c988c7363b (DEFAULT_TABLE table=test-table [id=30a165d0232541198d894b2fefcb1bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:49.634339 28603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 775a2100a9db4b488a8ef2c988c7363b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:49.634261 28881 tablet_service.cc:1467] Processing CreateTablet for tablet 775a2100a9db4b488a8ef2c988c7363b (DEFAULT_TABLE table=test-table [id=30a165d0232541198d894b2fefcb1bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:49.634703 28881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 775a2100a9db4b488a8ef2c988c7363b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:49.634756 28743 tablet_service.cc:1467] Processing CreateTablet for tablet 775a2100a9db4b488a8ef2c988c7363b (DEFAULT_TABLE table=test-table [id=30a165d0232541198d894b2fefcb1bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:49.635279 28743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 775a2100a9db4b488a8ef2c988c7363b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:49.641726 28982 tablet_bootstrap.cc:492] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: Bootstrap starting.
I20260806 13:01:49.642129 28983 tablet_bootstrap.cc:492] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Bootstrap starting.
I20260806 13:01:49.643867 28983 tablet_bootstrap.cc:654] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:49.643888 28982 tablet_bootstrap.cc:654] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:49.644445 28983 log.cc:824] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:49.644629 28982 log.cc:824] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:49.645140 28984 tablet_bootstrap.cc:492] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: Bootstrap starting.
I20260806 13:01:49.646013 28983 tablet_bootstrap.cc:492] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: No bootstrap required, opened a new log
I20260806 13:01:49.646013 28982 tablet_bootstrap.cc:492] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: No bootstrap required, opened a new log
I20260806 13:01:49.646111 28983 ts_tablet_manager.cc:1397] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 13:01:49.646111 28982 ts_tablet_manager.cc:1397] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260806 13:01:49.646620 28984 tablet_bootstrap.cc:654] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:49.647509 28984 log.cc:824] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:49.648770 28984 tablet_bootstrap.cc:492] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: No bootstrap required, opened a new log
I20260806 13:01:49.648900 28984 ts_tablet_manager.cc:1397] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 13:01:49.651532 28983 raft_consensus.cc:348] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.651532 28982 raft_consensus.cc:348] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.651831 28983 raft_consensus.cc:374] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:49.651831 28982 raft_consensus.cc:374] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:49.651875 28983 raft_consensus.cc:729] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3b447560a046c58c1b59fcbf4d6bbc, State: Initialized, Role: FOLLOWER
I20260806 13:01:49.651875 28982 raft_consensus.cc:729] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be75db4c51146688de144b205567c3a, State: Initialized, Role: FOLLOWER
I20260806 13:01:49.652055 28983 consensus_queue.cc:260] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.652099 28982 consensus_queue.cc:260] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.652499 28982 ts_tablet_manager.cc:1428] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 13:01:49.652501 28983 ts_tablet_manager.cc:1428] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260806 13:01:49.652964 28672 heartbeater.cc:503] Master 127.20.245.190:38107 was elected leader, sending a full tablet report...
I20260806 13:01:49.652840 28984 raft_consensus.cc:348] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.653060 28984 raft_consensus.cc:374] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:49.653106 28984 raft_consensus.cc:729] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0641dbd77c4b60b5eded7f96e69489, State: Initialized, Role: FOLLOWER
I20260806 13:01:49.653920 28949 heartbeater.cc:503] Master 127.20.245.190:38107 was elected leader, sending a full tablet report...
I20260806 13:01:49.655021 28984 consensus_queue.cc:260] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.655942 28984 ts_tablet_manager.cc:1428] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260806 13:01:49.656570 28810 heartbeater.cc:503] Master 127.20.245.190:38107 was elected leader, sending a full tablet report...
W20260806 13:01:49.710009 28674 tablet.cc:2369] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:49.747134 28990 raft_consensus.cc:482] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:49.747388 28990 raft_consensus.cc:504] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.748023 28990 leader_election.cc:288] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889), 7be75db4c51146688de144b205567c3a (127.20.245.131:40389)
I20260806 13:01:49.751529 28815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.748397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:44889 (local address 127.20.245.130:51133)
0806 13:01:49.748463 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.748476 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.748526 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.748786 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.748787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.748788 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:49.748849 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.748850 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.749562 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.749563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.750589 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.750592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.751223 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.751224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.751312 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.751317 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.751377 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.751422 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":19}
I20260806 13:01:49.751565 28973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.748535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:51133 (local address 127.20.245.129:44889)
0806 13:01:49.748616 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.748619 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.748654 (+ 35us) server_negotiation.cc:407] Connection header received
0806 13:01:49.748686 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.748686 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.748703 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.748763 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:49.748949 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.749476 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.750699 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.751097 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.751165 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.751227 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.751412 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.751483 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 13:01:49.751688 28977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.748438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:49143 (local address 127.20.245.131:40389)
0806 13:01:49.748511 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.748513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.748526 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:01:49.748567 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.748569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.748581 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.748651 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:49.748941 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.749609 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.750732 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.751162 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.751280 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.751293 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.751539 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.751599 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 13:01:49.751700 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.748291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:40389 (local address 127.20.245.130:49143)
0806 13:01:49.748370 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:49.748398 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:49.748454 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:49.748678 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:49.748680 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:49.748682 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:49.748837 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.748840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.749698 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.749699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.750591 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:49.750594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.751273 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.751274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:49.751446 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.751450 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:49.751510 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:01:49.751555 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":3}
I20260806 13:01:49.752031 28621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "775a2100a9db4b488a8ef2c988c7363b" candidate_uuid: "1c0641dbd77c4b60b5eded7f96e69489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" is_pre_election: true
I20260806 13:01:49.752161 28901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "775a2100a9db4b488a8ef2c988c7363b" candidate_uuid: "1c0641dbd77c4b60b5eded7f96e69489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be75db4c51146688de144b205567c3a" is_pre_election: true
I20260806 13:01:49.752328 28901 raft_consensus.cc:2454] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0641dbd77c4b60b5eded7f96e69489 in term 0.
I20260806 13:01:49.752321 28621 raft_consensus.cc:2454] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0641dbd77c4b60b5eded7f96e69489 in term 0.
I20260806 13:01:49.752619 28699 leader_election.cc:302] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0641dbd77c4b60b5eded7f96e69489, 2e3b447560a046c58c1b59fcbf4d6bbc; no voters:
I20260806 13:01:49.752869 28990 raft_consensus.cc:2781] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:49.752944 28990 raft_consensus.cc:482] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:49.752981 28990 raft_consensus.cc:3037] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:49.754485 28990 raft_consensus.cc:504] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.754794 28990 leader_election.cc:288] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [CANDIDATE]: Term 1 election: Requested vote from peers 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889), 7be75db4c51146688de144b205567c3a (127.20.245.131:40389)
I20260806 13:01:49.755085 28901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "775a2100a9db4b488a8ef2c988c7363b" candidate_uuid: "1c0641dbd77c4b60b5eded7f96e69489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be75db4c51146688de144b205567c3a"
I20260806 13:01:49.755151 28621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "775a2100a9db4b488a8ef2c988c7363b" candidate_uuid: "1c0641dbd77c4b60b5eded7f96e69489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc"
I20260806 13:01:49.755277 28901 raft_consensus.cc:3037] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:49.755398 28621 raft_consensus.cc:3037] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:49.756444 28621 raft_consensus.cc:2454] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0641dbd77c4b60b5eded7f96e69489 in term 1.
I20260806 13:01:49.756686 28901 raft_consensus.cc:2454] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0641dbd77c4b60b5eded7f96e69489 in term 1.
I20260806 13:01:49.756724 28699 leader_election.cc:302] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0641dbd77c4b60b5eded7f96e69489, 2e3b447560a046c58c1b59fcbf4d6bbc; no voters:
I20260806 13:01:49.756857 28990 raft_consensus.cc:2781] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:49.757084 28990 raft_consensus.cc:686] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 LEADER]: Becoming Leader. State: Replica: 1c0641dbd77c4b60b5eded7f96e69489, State: Running, Role: LEADER
I20260806 13:01:49.757230 28990 consensus_queue.cc:237] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } }
I20260806 13:01:49.758419 27689 catalog_manager.cc:5495] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0641dbd77c4b60b5eded7f96e69489 (127.20.245.130). New cstate: current_term: 1 leader_uuid: "1c0641dbd77c4b60b5eded7f96e69489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:49.759384 28967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } } }
I20260806 13:01:49.759492 28967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:49.760946 28993 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: attempting to promote NON_VOTER 8b84109f18aa4ab0b5297db822a2685c to VOTER
I20260806 13:01:49.760968 28967 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: attempting to promote NON_VOTER 8b84109f18aa4ab0b5297db822a2685c to VOTER
I20260806 13:01:49.761190 28993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
W20260806 13:01:49.761507 28967 raft_consensus.cc:1053] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: Unable to promote non-voter 8b84109f18aa4ab0b5297db822a2685c: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: NON_VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: true } }.
Pending config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
I20260806 13:01:49.761734 28310 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Refusing update from remote peer 50ddcad9609d42f19b5fd95c712d5b71: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260806 13:01:49.761742 28499 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 LEARNER]: Refusing update from remote peer 50ddcad9609d42f19b5fd95c712d5b71: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260806 13:01:49.762004 28965 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260806 13:01:49.762147 28967 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260806 13:01:49.763001 28993 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:49.763223 28310 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:49.763244 28499 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:49.764537 28993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:49.764639 28993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:49.764708 28993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:49.764768 28993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:49.764818 28993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:49.764875 28993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:49.764840 28531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:49.764956 28531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:01:49.765040 28996 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "50ddcad9609d42f19b5fd95c712d5b71" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:49.765158 28996 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:01:49.780138 28976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.777225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38312 (local address 127.20.245.130:45189)
0806 13:01:49.777294 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.777296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.777307 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:01:49.777370 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.777371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.777397 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.777498 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:49.777681 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.778229 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.779069 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.779384 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.779468 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.779692 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:49.779843 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:49.779970 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.779989 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.780018 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 13:01:49.783211 28901 raft_consensus.cc:1261] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 1 FOLLOWER]: Refusing update from remote peer 1c0641dbd77c4b60b5eded7f96e69489: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:49.783178 28621 raft_consensus.cc:1261] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 1 FOLLOWER]: Refusing update from remote peer 1c0641dbd77c4b60b5eded7f96e69489: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:49.783741 28990 consensus_queue.cc:1035] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:49.783931 28991 consensus_queue.cc:1035] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:49.792255 28999 mvcc.cc:205] Tried to move back new op lower bound from 7315543284867690496 to 7315543284766576640. Current Snapshot: MvccSnapshot[applied={T|T < 7315543284867690496}]
I20260806 13:01:49.794577 27690 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:49.794742 27690 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:49.797263 27690 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50ddcad9609d42f19b5fd95c712d5b71: Sending DeleteTablet for 3 replicas of tablet 775a2100a9db4b488a8ef2c988c7363b
I20260806 13:01:49.797838 28603 tablet_service.cc:1514] Processing DeleteTablet for tablet 775a2100a9db4b488a8ef2c988c7363b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:49 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:38146
I20260806 13:01:49.797983 28743 tablet_service.cc:1514] Processing DeleteTablet for tablet 775a2100a9db4b488a8ef2c988c7363b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:49 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:38306
I20260806 13:01:49.798172 28881 tablet_service.cc:1514] Processing DeleteTablet for tablet 775a2100a9db4b488a8ef2c988c7363b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:49 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:49998
I20260806 13:01:49.798367 29009 tablet_replica.cc:330] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: stopping tablet replica
I20260806 13:01:49.798524 29009 raft_consensus.cc:2229] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:49.798699 29009 raft_consensus.cc:2258] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:49.799489 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 27658
I20260806 13:01:49.799520 29009 ts_tablet_manager.cc:1905] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:49.803514 29010 tablet_replica.cc:330] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: stopping tablet replica
I20260806 13:01:49.803931 29010 raft_consensus.cc:2229] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:49.803974 29009 ts_tablet_manager.cc:1918] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:49.804100 29009 log.cc:1196] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/775a2100a9db4b488a8ef2c988c7363b
I20260806 13:01:49.804323 29010 raft_consensus.cc:2258] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:49.804474 29009 ts_tablet_manager.cc:1939] T 775a2100a9db4b488a8ef2c988c7363b P 1c0641dbd77c4b60b5eded7f96e69489: Deleting consensus metadata
I20260806 13:01:49.805135 29010 ts_tablet_manager.cc:1905] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:49.807499 29010 ts_tablet_manager.cc:1918] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:49.807631 29010 log.cc:1196] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/775a2100a9db4b488a8ef2c988c7363b
I20260806 13:01:49.807978 29010 ts_tablet_manager.cc:1939] T 775a2100a9db4b488a8ef2c988c7363b P 7be75db4c51146688de144b205567c3a: Deleting consensus metadata
W20260806 13:01:49.809662 28834 connection.cc:535] server connection from 127.0.0.1:49998 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 13:01:49.809701 28699 connection.cc:535] server connection from 127.0.0.1:38306 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 13:01:49.811375 29008 tablet_replica.cc:330] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: stopping tablet replica
I20260806 13:01:49.811582 29008 raft_consensus.cc:2229] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:49.811781 29008 raft_consensus.cc:2258] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:49.812877 29008 ts_tablet_manager.cc:1905] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:49.815346 29008 ts_tablet_manager.cc:1918] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:49.815465 29008 log.cc:1196] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/775a2100a9db4b488a8ef2c988c7363b
I20260806 13:01:49.815842 29008 ts_tablet_manager.cc:1939] T 775a2100a9db4b488a8ef2c988c7363b P 2e3b447560a046c58c1b59fcbf4d6bbc: Deleting consensus metadata
W20260806 13:01:49.816448 28558 connection.cc:441] server connection from 127.0.0.1:38146 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38146 (request call id 1) could send its response
I20260806 13:01:49.822463 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.812313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34194 (local address 127.20.245.188:43417)
0806 13:01:49.812384 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.812386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.812552 (+ 166us) server_negotiation.cc:407] Connection header received
0806 13:01:49.812678 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.812679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.812692 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.812729 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.813555 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.814392 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.815676 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.816058 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.816107 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.818415 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.818418 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.818419 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.818429 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.820632 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.821288 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.821290 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.821290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.821378 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.821681 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.821682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.821683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.821858 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.821946 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.822203 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.822336 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 13:01:49.822600 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.799232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43670 (local address 127.20.245.189:37783)
0806 13:01:49.799295 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.799298 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.811060 (+ 11762us) server_negotiation.cc:407] Connection header received
0806 13:01:49.811258 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.811261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.811287 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.811351 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.812848 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.813750 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.815352 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.815771 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.815857 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.818395 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.818397 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.818398 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.818417 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.820502 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.821060 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.821063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.821063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.821336 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.821623 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.821624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.821625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.821819 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.821946 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.822254 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.822483 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 13:01:49.833326 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.799353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34192 (local address 127.20.245.188:43417)
0806 13:01:49.799445 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.799448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.823441 (+ 23993us) server_negotiation.cc:407] Connection header received
0806 13:01:49.823601 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.823603 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.823619 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.823659 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.824672 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.825663 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.826939 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.827309 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.827401 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.829694 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.829696 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.829697 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.829708 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.831723 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.832214 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.832216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.832216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.832293 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.832541 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.832542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.832543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.832725 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.832824 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.833090 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.833195 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 13:01:49.833339 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:49.823881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43674 (local address 127.20.245.189:37783)
0806 13:01:49.823952 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:49.823954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:49.824524 (+ 570us) server_negotiation.cc:407] Connection header received
0806 13:01:49.824634 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:49.824635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:49.824648 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:49.824698 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:49.825690 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.826326 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.827207 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:49.827538 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:49.827614 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:49.830078 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:49.830080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:49.830081 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:49.830090 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:49.831975 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.832373 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.832375 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.832376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.832444 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:49.832673 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:49.832674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:49.832674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:49.832816 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:49.832938 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:49.833077 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 13:01:49.833195 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 13:01:50.792892 29019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:50.792452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:54511)
0806 13:01:50.792674 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:50.792804 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":118,"threads_started":1}
I20260806 13:01:50.792904 29018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:50.792434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:37761)
0806 13:01:50.792725 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:50.792845 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":131,"threads_started":1}
W20260806 13:01:50.793315 28810 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:38107 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
W20260806 13:01:50.793347 28949 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:38107 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:50.793465 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:50.793006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:37001)
0806 13:01:50.793308 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:50.793405 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":74,"threads_started":1}
W20260806 13:01:50.793696 28672 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:38107 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:51.297135 29021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50ddcad9609d42f19b5fd95c712d5b71)
I20260806 13:01:51.297410 29021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
I20260806 13:01:51.297611 29022 raft_consensus.cc:482] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50ddcad9609d42f19b5fd95c712d5b71)
I20260806 13:01:51.297879 29021 leader_election.cc:288] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107), a66875f0a60848dfb9277929dbee2046 (127.20.245.189:37783)
I20260806 13:01:51.297824 29022 raft_consensus.cc:504] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
I20260806 13:01:51.298166 29022 leader_election.cc:288] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107), 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188:43417)
I20260806 13:01:51.298440 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.298096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:35932)
0806 13:01:51.298279 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.298376 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
W20260806 13:01:51.298664 28473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:51.298853 29027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.298263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:35946)
0806 13:01:51.298662 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.298735 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":64,"threads_started":1}
W20260806 13:01:51.299104 28284 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:51.299259 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.299100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:35954)
0806 13:01:51.299152 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.299220 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 13:01:51.299433 28473 leader_election.cc:334] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107): Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:51.299885 29027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.299750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:35960)
0806 13:01:51.299817 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.299845 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 13:01:51.299983 28284 leader_election.cc:334] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107): Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:51.302013 29024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.298128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:37783 (local address 127.0.0.1:33478)
0806 13:01:51.298385 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.298397 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:51.298611 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:51.298864 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:51.298866 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:51.298869 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:51.298952 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:51.298955 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:51.300095 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:51.300096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:51.300969 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:51.300972 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:51.301741 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:51.301742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:51.301810 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:51.301817 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:01:51.301878 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 13:01:51.301942 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":77,"threads_started":1}
I20260806 13:01:51.302147 29026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.298273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33478 (local address 127.20.245.189:37783)
0806 13:01:51.298654 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:51.298656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:51.298677 (+ 21us) server_negotiation.cc:407] Connection header received
0806 13:01:51.298715 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:51.298716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:51.298730 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:51.298807 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:51.299037 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:51.299974 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:51.301078 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:51.301620 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:51.301703 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:51.301714 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:51.301932 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 13:01:51.302013 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":68,"threads_started":1}
I20260806 13:01:51.302349 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.298481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:43417 (local address 127.0.0.1:47266)
0806 13:01:51.298727 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.298737 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:51.298789 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:51.299264 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:51.299265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:51.299268 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:51.299311 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:51.299312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:51.300216 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:51.300217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:51.301174 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:51.301176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:51.301936 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:51.301938 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:51.302018 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:51.302022 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:51.302110 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 13:01:51.302272 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":42,"threads_started":1}
I20260806 13:01:51.302477 28310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b84109f18aa4ab0b5297db822a2685c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a66875f0a60848dfb9277929dbee2046" is_pre_election: true
I20260806 13:01:51.302635 29029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.298885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47266 (local address 127.20.245.188:43417)
0806 13:01:51.299084 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:51.299086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:51.299091 (+ 5us) server_negotiation.cc:407] Connection header received
0806 13:01:51.299110 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:51.299111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:51.299121 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:51.299378 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:51.299420 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:51.300134 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:51.301293 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:51.301796 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:51.301887 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:51.301895 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:51.302505 (+ 610us) server_negotiation.cc:299] Negotiation successful
0806 13:01:51.302568 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":108,"threads_started":1}
I20260806 13:01:51.302644 28310 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b84109f18aa4ab0b5297db822a2685c in term 1.
I20260806 13:01:51.302841 28475 leader_election.cc:302] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b84109f18aa4ab0b5297db822a2685c, a66875f0a60848dfb9277929dbee2046; no voters: 50ddcad9609d42f19b5fd95c712d5b71
I20260806 13:01:51.302858 28499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a66875f0a60848dfb9277929dbee2046" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8b84109f18aa4ab0b5297db822a2685c" is_pre_election: true
I20260806 13:01:51.303006 28499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a66875f0a60848dfb9277929dbee2046 in term 1.
I20260806 13:01:51.303053 29021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 13:01:51.303122 29021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50ddcad9609d42f19b5fd95c712d5b71)
I20260806 13:01:51.303158 29021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 1 FOLLOWER]: Advancing to term 2
I20260806 13:01:51.303248 28283 leader_election.cc:302] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b84109f18aa4ab0b5297db822a2685c, a66875f0a60848dfb9277929dbee2046; no voters: 50ddcad9609d42f19b5fd95c712d5b71
I20260806 13:01:51.303433 29022 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 13:01:51.303488 29022 raft_consensus.cc:482] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50ddcad9609d42f19b5fd95c712d5b71)
I20260806 13:01:51.303524 29022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 1 FOLLOWER]: Advancing to term 2
I20260806 13:01:51.304345 29021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
I20260806 13:01:51.304464 29022 raft_consensus.cc:504] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
I20260806 13:01:51.304553 29021 leader_election.cc:288] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [CANDIDATE]: Term 2 election: Requested vote from peers 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107), a66875f0a60848dfb9277929dbee2046 (127.20.245.189:37783)
I20260806 13:01:51.304648 29022 leader_election.cc:288] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 2 election: Requested vote from peers 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107), 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188:43417)
I20260806 13:01:51.304800 28310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b84109f18aa4ab0b5297db822a2685c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a66875f0a60848dfb9277929dbee2046"
I20260806 13:01:51.304821 28499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a66875f0a60848dfb9277929dbee2046" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8b84109f18aa4ab0b5297db822a2685c"
I20260806 13:01:51.304911 28310 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b84109f18aa4ab0b5297db822a2685c in current term 2: Already voted for candidate a66875f0a60848dfb9277929dbee2046 in this term.
I20260806 13:01:51.304924 28499 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a66875f0a60848dfb9277929dbee2046 in current term 2: Already voted for candidate 8b84109f18aa4ab0b5297db822a2685c in this term.
I20260806 13:01:51.304942 29024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.304704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:35964)
0806 13:01:51.304759 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.304801 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 13:01:51.305145 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.304783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:35976)
0806 13:01:51.304875 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.304903 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 13:01:51.305385 29024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.305276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:35988)
0806 13:01:51.305321 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.305351 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260806 13:01:51.305487 28473 leader_election.cc:334] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107): Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:51.305507 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.305392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:35990)
0806 13:01:51.305449 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.305479 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 13:01:51.305544 28473 leader_election.cc:302] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b84109f18aa4ab0b5297db822a2685c; no voters: 50ddcad9609d42f19b5fd95c712d5b71, a66875f0a60848dfb9277929dbee2046
I20260806 13:01:51.305610 29021 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260806 13:01:51.305599 28284 leader_election.cc:334] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107): Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:51.305656 28284 leader_election.cc:302] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a66875f0a60848dfb9277929dbee2046; no voters: 50ddcad9609d42f19b5fd95c712d5b71, 8b84109f18aa4ab0b5297db822a2685c
I20260806 13:01:51.305734 29022 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260806 13:01:51.794045 29032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.793736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:45179)
0806 13:01:51.793941 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.793980 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":125,"threads_started":1}
I20260806 13:01:51.794045 29031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.793758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:42757)
0806 13:01:51.793906 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.793969 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":84,"threads_started":1}
I20260806 13:01:51.794431 29033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:51.794023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:58193)
0806 13:01:51.794327 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:51.794369 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":84,"threads_started":1}
I20260806 13:01:52.795014 29034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.794662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:39101)
0806 13:01:52.794849 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.794932 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":106,"threads_started":1}
I20260806 13:01:52.795218 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.794662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:53583)
0806 13:01:52.794974 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.795025 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":108,"threads_started":1}
I20260806 13:01:52.795389 29036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.795019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:37729)
0806 13:01:52.795282 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.795338 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":74,"threads_started":1}
I20260806 13:01:52.893525 29037 raft_consensus.cc:482] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:52.893674 29037 raft_consensus.cc:504] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
I20260806 13:01:52.893926 29037 leader_election.cc:288] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107), 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188:43417)
I20260806 13:01:52.894418 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.894133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:36210)
0806 13:01:52.894307 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.894368 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":92,"threads_started":1}
I20260806 13:01:52.894366 28499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a66875f0a60848dfb9277929dbee2046" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8b84109f18aa4ab0b5297db822a2685c" is_pre_election: true
I20260806 13:01:52.894544 28499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a66875f0a60848dfb9277929dbee2046 in term 2.
I20260806 13:01:52.894791 28283 leader_election.cc:302] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b84109f18aa4ab0b5297db822a2685c, a66875f0a60848dfb9277929dbee2046; no voters:
I20260806 13:01:52.894938 29037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 13:01:52.894990 29037 raft_consensus.cc:482] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:52.895013 29037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 2 FOLLOWER]: Advancing to term 3
I20260806 13:01:52.895045 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.894902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:36224)
0806 13:01:52.894963 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.895010 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260806 13:01:52.895120 28284 leader_election.cc:334] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107): Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:52.896103 29037 raft_consensus.cc:504] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
I20260806 13:01:52.896277 29037 leader_election.cc:288] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 3 election: Requested vote from peers 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107), 8b84109f18aa4ab0b5297db822a2685c (127.20.245.188:43417)
I20260806 13:01:52.896533 28499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a66875f0a60848dfb9277929dbee2046" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8b84109f18aa4ab0b5297db822a2685c"
I20260806 13:01:52.896581 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.896393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:36240)
0806 13:01:52.896512 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.896550 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260806 13:01:52.896646 28499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 2 FOLLOWER]: Advancing to term 3
I20260806 13:01:52.896967 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.896839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:36250)
0806 13:01:52.896915 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.896941 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 13:01:52.897060 28284 leader_election.cc:334] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107): Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
I20260806 13:01:52.897698 28499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a66875f0a60848dfb9277929dbee2046 in term 3.
I20260806 13:01:52.897989 28283 leader_election.cc:302] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b84109f18aa4ab0b5297db822a2685c, a66875f0a60848dfb9277929dbee2046; no voters: 50ddcad9609d42f19b5fd95c712d5b71
I20260806 13:01:52.898095 29037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 13:01:52.898268 29037 raft_consensus.cc:686] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [term 3 LEADER]: Becoming Leader. State: Replica: a66875f0a60848dfb9277929dbee2046, State: Running, Role: LEADER
I20260806 13:01:52.898350 29037 consensus_queue.cc:237] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } }
I20260806 13:01:52.898785 29040 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a66875f0a60848dfb9277929dbee2046. Latest consensus state: current_term: 3 leader_uuid: "a66875f0a60848dfb9277929dbee2046" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:52.898880 29040 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:52.899080 29042 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:52.899775 29042 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:52.899897 29042 catalog_manager.cc:1259] Loaded cluster ID: dd3ce48949614c53ab5b831e38566709
I20260806 13:01:52.899953 29042 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:01:52.900170 29042 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:52.900286 29042 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Loaded TSK: 0
I20260806 13:01:52.900465 29042 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:01:52.953749 28299 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:52.956470 28299 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:52.958045 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.957879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:36264)
0806 13:01:52.957927 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.957994 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260806 13:01:52.958133 28499 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [term 3 FOLLOWER]: Refusing update from remote peer a66875f0a60848dfb9277929dbee2046: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260806 13:01:52.958618 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.958455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.0.0.1:36266)
0806 13:01:52.958515 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.958555 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 13:01:52.958554 29037 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260806 13:01:52.958711 28284 consensus_peers.cc:487] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 -> Peer 50ddcad9609d42f19b5fd95c712d5b71 (127.20.245.190:38107): Couldn't send request to peer 50ddcad9609d42f19b5fd95c712d5b71. Status: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 13:01:52.959553 29045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a66875f0a60848dfb9277929dbee2046. Latest consensus state: current_term: 3 leader_uuid: "a66875f0a60848dfb9277929dbee2046" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:52.959682 29045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:01:52.960345 29044 mvcc.cc:205] Tried to move back new op lower bound from 7315543297872916480 to 7315543297632395264. Current Snapshot: MvccSnapshot[applied={T|T < 7315543297872916480}]
I20260806 13:01:52.960458 29037 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a66875f0a60848dfb9277929dbee2046" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:52.960597 29037 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046 [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:52.960847 29045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a66875f0a60848dfb9277929dbee2046" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "50ddcad9609d42f19b5fd95c712d5b71" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38107 } } peers { permanent_uuid: "a66875f0a60848dfb9277929dbee2046" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 37783 } attrs { promote: false } } peers { permanent_uuid: "8b84109f18aa4ab0b5297db822a2685c" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 43417 } attrs { promote: false } } }
I20260806 13:01:52.961190 29046 mvcc.cc:205] Tried to move back new op lower bound from 7315543297872916480 to 7315543297632395264. Current Snapshot: MvccSnapshot[applied={T|T < 7315543297872916480 or (T in {7315543297872916480})}]
I20260806 13:01:52.961613 29045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b84109f18aa4ab0b5297db822a2685c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:01:52.967401 29054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.963505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45189 (local address 127.0.0.1:55022)
0806 13:01:52.964010 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.964022 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:52.964117 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:52.964323 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:52.964324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:52.964326 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:52.964385 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:52.964386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.965249 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.965250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:52.966386 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:52.966389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.967047 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.967049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:52.967114 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:52.967119 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:52.967230 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 13:01:52.967287 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":4,"thread_start_us":392,"threads_started":1}
I20260806 13:01:52.967391 29051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.963658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55022 (local address 127.20.245.130:45189)
0806 13:01:52.963868 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:52.963871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:52.964084 (+ 213us) server_negotiation.cc:407] Connection header received
0806 13:01:52.964186 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:52.964188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:52.964202 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:52.964311 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:52.964464 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.965162 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.966488 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.966958 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.967055 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:52.967067 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:52.967240 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 13:01:52.967291 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":112,"threads_started":1}
I20260806 13:01:52.967849 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.963392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:40389 (local address 127.0.0.1:33030)
0806 13:01:52.963443 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.963459 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:52.963530 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:52.964065 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:52.964067 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:52.964069 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:52.964161 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:52.964174 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.965527 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.965528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:52.966651 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:52.966654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.967604 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.967605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:52.967678 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:52.967682 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:52.967716 (+ 34us) client_negotiation.cc:240] Negotiation successful
0806 13:01:52.967765 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260806 13:01:52.968194 28743 tablet_service.cc:1467] Processing CreateTablet for tablet 0762018c007f4573b3c59ad8d6951f54 (DEFAULT_TABLE table=test-table [id=29fdb74138db4ac0afc9f4850897ecf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:52.968302 29050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.963515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33030 (local address 127.20.245.131:40389)
0806 13:01:52.963847 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:52.963849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:52.963857 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:01:52.963886 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:52.963886 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:52.963923 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:52.964382 (+ 459us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:52.964462 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.965384 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.966756 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.967492 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.967984 (+ 492us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:52.968000 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:52.968024 (+ 24us) server_negotiation.cc:299] Negotiation successful
0806 13:01:52.968116 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":95,"threads_started":1}
I20260806 13:01:52.968395 28743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0762018c007f4573b3c59ad8d6951f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:52.968606 28881 tablet_service.cc:1467] Processing CreateTablet for tablet 0762018c007f4573b3c59ad8d6951f54 (DEFAULT_TABLE table=test-table [id=29fdb74138db4ac0afc9f4850897ecf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:52.968760 28881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0762018c007f4573b3c59ad8d6951f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:52.969267 29052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.963671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55590 (local address 127.20.245.129:44889)
0806 13:01:52.963938 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:52.963940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:52.964053 (+ 113us) server_negotiation.cc:407] Connection header received
0806 13:01:52.964170 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:52.964172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:52.964185 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:52.964235 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:52.964726 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.965562 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.968103 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.968811 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.968878 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:52.968890 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:52.969123 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 13:01:52.969180 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":123,"threads_started":1}
I20260806 13:01:52.969534 29053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.963473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:44889 (local address 127.0.0.1:55590)
0806 13:01:52.963982 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.963993 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:52.964083 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:52.964485 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:52.964486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:52.964489 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:52.964556 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:52.964558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.965691 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.965692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:52.967982 (+ 2290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:52.967985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:52.968967 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:52.968968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:52.969032 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:52.969036 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:52.969374 (+ 338us) client_negotiation.cc:240] Negotiation successful
0806 13:01:52.969432 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":482,"threads_started":1}
I20260806 13:01:52.970350 29055 tablet_bootstrap.cc:492] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: Bootstrap starting.
I20260806 13:01:52.970551 28603 tablet_service.cc:1467] Processing CreateTablet for tablet 0762018c007f4573b3c59ad8d6951f54 (DEFAULT_TABLE table=test-table [id=29fdb74138db4ac0afc9f4850897ecf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:52.970692 29056 tablet_bootstrap.cc:492] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: Bootstrap starting.
I20260806 13:01:52.970732 28603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0762018c007f4573b3c59ad8d6951f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:52.970878 29055 tablet_bootstrap.cc:654] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:52.971275 29056 tablet_bootstrap.cc:654] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:52.971700 29055 tablet_bootstrap.cc:492] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: No bootstrap required, opened a new log
I20260806 13:01:52.971774 29055 ts_tablet_manager.cc:1397] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:52.971963 29055 raft_consensus.cc:348] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.972075 29055 raft_consensus.cc:374] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:52.972097 29055 raft_consensus.cc:729] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0641dbd77c4b60b5eded7f96e69489, State: Initialized, Role: FOLLOWER
I20260806 13:01:52.972110 29056 tablet_bootstrap.cc:492] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: No bootstrap required, opened a new log
I20260806 13:01:52.972170 29056 ts_tablet_manager.cc:1397] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:52.972175 29055 consensus_queue.cc:260] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.972334 29056 raft_consensus.cc:348] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.972431 29056 raft_consensus.cc:374] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:52.972457 29056 raft_consensus.cc:729] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be75db4c51146688de144b205567c3a, State: Initialized, Role: FOLLOWER
I20260806 13:01:52.972513 29056 consensus_queue.cc:260] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.972738 29056 ts_tablet_manager.cc:1428] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:52.973258 29034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.973057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:58037)
0806 13:01:52.973158 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.973215 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 13:01:52.972404 29055 ts_tablet_manager.cc:1428] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:52.973552 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.972638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:39839)
0806 13:01:52.972702 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.972740 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 13:01:52.973568 28811 heartbeater.cc:503] Master 127.20.245.189:37783 was elected leader, sending a full tablet report...
I20260806 13:01:52.973868 29034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.973766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:44225)
0806 13:01:52.973809 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.973838 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 13:01:52.973919 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.973815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:59385)
0806 13:01:52.973855 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.973891 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260806 13:01:52.974009 28950 heartbeater.cc:503] Master 127.20.245.189:37783 was elected leader, sending a full tablet report...
I20260806 13:01:52.974908 29061 tablet_bootstrap.cc:492] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc: Bootstrap starting.
I20260806 13:01:52.975525 29061 tablet_bootstrap.cc:654] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:52.976359 29061 tablet_bootstrap.cc:492] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc: No bootstrap required, opened a new log
I20260806 13:01:52.976411 29061 ts_tablet_manager.cc:1397] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 13:01:52.976549 29061 raft_consensus.cc:348] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.976617 29061 raft_consensus.cc:374] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:52.976631 29061 raft_consensus.cc:729] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3b447560a046c58c1b59fcbf4d6bbc, State: Initialized, Role: FOLLOWER
I20260806 13:01:52.976742 29061 consensus_queue.cc:260] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.977026 29061 ts_tablet_manager.cc:1428] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:52.977602 29036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.977436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:49449)
0806 13:01:52.977506 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.977547 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 13:01:52.977886 28673 heartbeater.cc:503] Master 127.20.245.189:37783 was elected leader, sending a full tablet report...
I20260806 13:01:52.978235 29036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.978055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:57499)
0806 13:01:52.978162 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.978203 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260806 13:01:52.991459 29060 raft_consensus.cc:482] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:52.991622 29060 raft_consensus.cc:504] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.991863 29060 leader_election.cc:288] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be75db4c51146688de144b205567c3a (127.20.245.131:40389), 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889)
I20260806 13:01:52.992228 28901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0762018c007f4573b3c59ad8d6951f54" candidate_uuid: "1c0641dbd77c4b60b5eded7f96e69489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be75db4c51146688de144b205567c3a" is_pre_election: true
I20260806 13:01:52.992214 28621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0762018c007f4573b3c59ad8d6951f54" candidate_uuid: "1c0641dbd77c4b60b5eded7f96e69489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" is_pre_election: true
I20260806 13:01:52.992355 28901 raft_consensus.cc:2454] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0641dbd77c4b60b5eded7f96e69489 in term 0.
I20260806 13:01:52.992355 28621 raft_consensus.cc:2454] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0641dbd77c4b60b5eded7f96e69489 in term 0.
I20260806 13:01:52.992579 28697 leader_election.cc:302] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0641dbd77c4b60b5eded7f96e69489, 7be75db4c51146688de144b205567c3a; no voters:
I20260806 13:01:52.992767 29060 raft_consensus.cc:2781] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:52.992830 29060 raft_consensus.cc:482] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:52.992851 29060 raft_consensus.cc:3037] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:52.993983 29060 raft_consensus.cc:504] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.994182 29060 leader_election.cc:288] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [CANDIDATE]: Term 1 election: Requested vote from peers 7be75db4c51146688de144b205567c3a (127.20.245.131:40389), 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889)
I20260806 13:01:52.994403 28901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0762018c007f4573b3c59ad8d6951f54" candidate_uuid: "1c0641dbd77c4b60b5eded7f96e69489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be75db4c51146688de144b205567c3a"
I20260806 13:01:52.994408 28621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0762018c007f4573b3c59ad8d6951f54" candidate_uuid: "1c0641dbd77c4b60b5eded7f96e69489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc"
I20260806 13:01:52.994529 28901 raft_consensus.cc:3037] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:52.994527 28621 raft_consensus.cc:3037] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:52.995368 28901 raft_consensus.cc:2454] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0641dbd77c4b60b5eded7f96e69489 in term 1.
I20260806 13:01:52.995447 28621 raft_consensus.cc:2454] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0641dbd77c4b60b5eded7f96e69489 in term 1.
I20260806 13:01:52.995586 28697 leader_election.cc:302] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0641dbd77c4b60b5eded7f96e69489, 7be75db4c51146688de144b205567c3a; no voters:
I20260806 13:01:52.995697 29060 raft_consensus.cc:2781] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:52.995887 29060 raft_consensus.cc:686] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 LEADER]: Becoming Leader. State: Replica: 1c0641dbd77c4b60b5eded7f96e69489, State: Running, Role: LEADER
I20260806 13:01:52.995942 29060 consensus_queue.cc:237] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } }
I20260806 13:01:52.996491 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:52.996353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:34239)
0806 13:01:52.996402 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:52.996448 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260806 13:01:52.996721 28297 catalog_manager.cc:5495] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0641dbd77c4b60b5eded7f96e69489 (127.20.245.130). New cstate: current_term: 1 leader_uuid: "1c0641dbd77c4b60b5eded7f96e69489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c0641dbd77c4b60b5eded7f96e69489" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260806 13:01:53.008129 29051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:53.005005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55030 (local address 127.20.245.130:45189)
0806 13:01:53.005184 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:53.005192 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:53.005209 (+ 17us) server_negotiation.cc:407] Connection header received
0806 13:01:53.005249 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:53.005250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:53.005280 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:53.005350 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:53.005529 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:53.006163 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:53.007016 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:53.007400 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:53.007478 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:53.007654 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:53.007696 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:53.007758 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:53.007862 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 13:01:53.007922 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260806 13:01:53.009558 28901 raft_consensus.cc:1261] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 1 FOLLOWER]: Refusing update from remote peer 1c0641dbd77c4b60b5eded7f96e69489: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:53.009546 28621 raft_consensus.cc:1261] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [term 1 FOLLOWER]: Refusing update from remote peer 1c0641dbd77c4b60b5eded7f96e69489: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:53.009917 29065 consensus_queue.cc:1035] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3b447560a046c58c1b59fcbf4d6bbc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:53.010092 29060 consensus_queue.cc:1035] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be75db4c51146688de144b205567c3a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:53.011418 29036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:53.010836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:39705)
0806 13:01:53.011292 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:53.011357 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413}
I20260806 13:01:53.011984 29034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:53.011847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:49283)
0806 13:01:53.011904 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:53.011937 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 13:01:53.012797 29069 mvcc.cc:205] Tried to move back new op lower bound from 7315543298084495360 to 7315543298032185344. Current Snapshot: MvccSnapshot[applied={T|T < 7315543298084495360}]
I20260806 13:01:53.013800 29036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:53.013664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.129:39713)
0806 13:01:53.013715 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:53.013750 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 13:01:53.014096 29034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:53.013969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.131:46403)
0806 13:01:53.014019 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:53.014051 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260806 13:01:53.014565 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:53.014321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:54495)
0806 13:01:53.014475 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:53.014510 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260806 13:01:53.014961 28298 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:53.015130 28298 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:53.015215 29070 mvcc.cc:205] Tried to move back new op lower bound from 7315543298084495360 to 7315543298032185344. Current Snapshot: MvccSnapshot[applied={T|T < 7315543298084495360}]
I20260806 13:01:53.016265 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:53.015926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:38107 (local address 127.20.245.130:44703)
0806 13:01:53.016104 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:53.016151 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260806 13:01:53.017246 28298 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a66875f0a60848dfb9277929dbee2046: Sending DeleteTablet for 3 replicas of tablet 0762018c007f4573b3c59ad8d6951f54
I20260806 13:01:53.017722 28881 tablet_service.cc:1514] Processing DeleteTablet for tablet 0762018c007f4573b3c59ad8d6951f54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:53 UTC) from {username='oryx', principal='oryx/127.20.245.189@KRBTEST.COM'} at 127.0.0.1:33030
I20260806 13:01:53.017892 28603 tablet_service.cc:1514] Processing DeleteTablet for tablet 0762018c007f4573b3c59ad8d6951f54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:53 UTC) from {username='oryx', principal='oryx/127.20.245.189@KRBTEST.COM'} at 127.0.0.1:55590
I20260806 13:01:53.018046 29079 tablet_replica.cc:330] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: stopping tablet replica
I20260806 13:01:53.018117 28743 tablet_service.cc:1514] Processing DeleteTablet for tablet 0762018c007f4573b3c59ad8d6951f54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:53 UTC) from {username='oryx', principal='oryx/127.20.245.189@KRBTEST.COM'} at 127.0.0.1:55022
I20260806 13:01:53.018146 29079 raft_consensus.cc:2229] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:53.018210 29079 raft_consensus.cc:2258] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:53.018471 29081 tablet_replica.cc:330] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: stopping tablet replica
I20260806 13:01:53.018489 29080 tablet_replica.cc:330] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc: stopping tablet replica
I20260806 13:01:53.018537 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 28449
I20260806 13:01:53.018576 29080 raft_consensus.cc:2229] T 0762018c007f4573b3c59ad8d6951f54 P 2e3b447560a046c58c1b59fcbf4d6bbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:53.018576 29081 raft_consensus.cc:2229] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:53.019363 29081 raft_consensus.cc:2258] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:53.019876 29081 ts_tablet_manager.cc:1905] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:53.021621 29081 ts_tablet_manager.cc:1918] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:53.021715 29081 log.cc:1196] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/0762018c007f4573b3c59ad8d6951f54
I20260806 13:01:53.021991 29081 ts_tablet_manager.cc:1939] T 0762018c007f4573b3c59ad8d6951f54 P 1c0641dbd77c4b60b5eded7f96e69489: Deleting consensus metadata
I20260806 13:01:53.022413 28284 catalog_manager.cc:4841] TS 1c0641dbd77c4b60b5eded7f96e69489 (127.20.245.130:45189): tablet 0762018c007f4573b3c59ad8d6951f54 (table test-table [id=29fdb74138db4ac0afc9f4850897ecf1]) successfully deleted
I20260806 13:01:53.028347 29079 ts_tablet_manager.cc:1905] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:53.029131 29053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:53.028926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:44889 (local address 127.0.0.1:55596)
0806 13:01:53.029013 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:53.029059 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:44889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 13:01:53.029312 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 28679
W20260806 13:01:53.030902 28286 catalog_manager.cc:4584] TS 2e3b447560a046c58c1b59fcbf4d6bbc (127.20.245.129:44889): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0762018c007f4573b3c59ad8d6951f54: Network error: Client connection negotiation failed: client connection to 127.20.245.129:44889: connect: Connection refused (error 111)
I20260806 13:01:53.031075 29079 ts_tablet_manager.cc:1918] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:53.031150 29079 log.cc:1196] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/0762018c007f4573b3c59ad8d6951f54
I20260806 13:01:53.031451 29079 ts_tablet_manager.cc:1939] T 0762018c007f4573b3c59ad8d6951f54 P 7be75db4c51146688de144b205567c3a: Deleting consensus metadata
I20260806 13:01:53.032358 28284 catalog_manager.cc:4841] TS 7be75db4c51146688de144b205567c3a (127.20.245.131:40389): tablet 0762018c007f4573b3c59ad8d6951f54 (table test-table [id=29fdb74138db4ac0afc9f4850897ecf1]) successfully deleted
I20260806 13:01:53.038565 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 28816
I20260806 13:01:53.045279 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 28159
I20260806 13:01:53.053315 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 28271
2026-08-06T13:01:53Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6899 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:53 dist-test-slave-srgv krb5kdc[29084](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:53 dist-test-slave-srgv krb5kdc[29084](info): set up 2 sockets
Aug 06 13:01:53 dist-test-slave-srgv krb5kdc[29084](info): commencing operation
krb5kdc: starting...
W20260806 13:01:54.148236 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:54 dist-test-slave-srgv krb5kdc[29084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:54Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.190.keytab.
Entry for principal oryx/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.190.keytab.
I20260806 13:01:54.307250 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:42831
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.190.keytab
--principal=oryx/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:45573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:42831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:54.408785 29099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:54.409296 29099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:54.409358 29099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:54.411409 29099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:54.411520 29099 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 13:01:54.411543 29099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:54.411568 29099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:54.411590 29099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:54.411620 29099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:54.415154 29099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:45573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:42831
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.190.keytab
--principal=oryx/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:42831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:54.415712 29099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:54.416136 29099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:54.422662 29104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:54.422662 29105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:54.422776 29107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:54.422837 29099 server_base.cc:1034] running on GCE node
I20260806 13:01:54.423287 29099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:54.423723 29099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:54.424937 29099 hybrid_clock.cc:648] HybridClock initialized: now 1786021314424931 us; error 47 us; skew 500 ppm
Aug 06 13:01:54 dist-test-slave-srgv krb5kdc[29084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021314, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:54.435021 29099 init.cc:377] Logged in from keytab as oryx/127.20.245.190@KRBTEST.COM (short username oryx)
I20260806 13:01:54.435829 29099 webserver.cc:460] Webserver started at http://127.20.245.190:42089/ using document root <none> and password file <none>
I20260806 13:01:54.436152 29099 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:54.436251 29099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:54.436442 29099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:54.437909 29099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "ec178a5e42944712a82812b32cdcc3cc"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "af467840039881ba9c7072484b3d209f"
server_key_iv: "ccfd207a04cc1c2d92697045e89dcd41"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.438388 29099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "ec178a5e42944712a82812b32cdcc3cc"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "af467840039881ba9c7072484b3d209f"
server_key_iv: "ccfd207a04cc1c2d92697045e89dcd41"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.440428 29099 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 13:01:54.441696 29114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:54.441989 29099 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:54.442140 29099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "ec178a5e42944712a82812b32cdcc3cc"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "af467840039881ba9c7072484b3d209f"
server_key_iv: "ccfd207a04cc1c2d92697045e89dcd41"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.442263 29099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:54.477135 29099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:54.480420 29099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:54.480662 29099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:54.487138 29099 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:42831
I20260806 13:01:54.487255 29178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:42831 every 8 connection(s)
I20260806 13:01:54.487731 29099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:54.488714 29179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:54.492429 29179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: Bootstrap starting.
I20260806 13:01:54.493379 29179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:54.493815 29179 log.cc:824] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:54.494848 29179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: No bootstrap required, opened a new log
I20260806 13:01:54.495726 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 29099
I20260806 13:01:54.495891 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:54.496115 21462 external_mini_cluster.cc:1428] Setting key 856c526a29b2ab90b65a586261170ab5
I20260806 13:01:54.498852 29179 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec178a5e42944712a82812b32cdcc3cc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42831 } }
I20260806 13:01:54.499140 29179 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:54.499233 29179 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec178a5e42944712a82812b32cdcc3cc, State: Initialized, Role: FOLLOWER
I20260806 13:01:54.499451 29179 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec178a5e42944712a82812b32cdcc3cc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42831 } }
I20260806 13:01:54.499558 29179 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:54.499609 29179 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:54.499676 29179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:54.500783 29179 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec178a5e42944712a82812b32cdcc3cc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42831 } }
I20260806 13:01:54.500943 29179 leader_election.cc:302] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec178a5e42944712a82812b32cdcc3cc; no voters:
I20260806 13:01:54.501180 29179 leader_election.cc:288] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:54.501281 29184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:54.501477 29184 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [term 1 LEADER]: Becoming Leader. State: Replica: ec178a5e42944712a82812b32cdcc3cc, State: Running, Role: LEADER
I20260806 13:01:54.501590 29184 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec178a5e42944712a82812b32cdcc3cc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42831 } }
I20260806 13:01:54.501612 29179 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:54.502168 29185 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec178a5e42944712a82812b32cdcc3cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec178a5e42944712a82812b32cdcc3cc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42831 } } }
I20260806 13:01:54.502327 29185 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:54.502193 29184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec178a5e42944712a82812b32cdcc3cc. Latest consensus state: current_term: 1 leader_uuid: "ec178a5e42944712a82812b32cdcc3cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec178a5e42944712a82812b32cdcc3cc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 42831 } } }
I20260806 13:01:54.502583 29184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:54.502760 29191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:54.503568 29191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:54.505991 29191 catalog_manager.cc:1347] Generated new cluster ID: 8e0f74ec8b134aef8c8dd9e5b3b029ca
I20260806 13:01:54.506062 29191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:01:54 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:54.512768 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.497006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58820 (local address 127.20.245.190:42831)
0806 13:01:54.497310 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:54.497325 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:54.497382 (+ 57us) server_negotiation.cc:407] Connection header received
0806 13:01:54.498765 (+ 1383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:54.498782 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:54.498882 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:54.499120 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:54.500218 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.501945 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.503272 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.504013 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.504175 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.507880 (+ 3705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:54.507887 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:54.507888 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:54.507908 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:54.510485 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.511074 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.511078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.511078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.511260 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.511519 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.511520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.511520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.511940 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:54.512121 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:54.512292 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 13:01:54.512472 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":157,"threads_started":1}
I20260806 13:01:54.518389 29191 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:54.519145 29191 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:54.526043 29191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: Generated new TSK 0
I20260806 13:01:54.526376 29191 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab.
Entry for principal oryx/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab.
I20260806 13:01:54.568095 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42831
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab
--principal=oryx/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:45573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:54.671613 29205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:54.671974 29205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:54.672024 29205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:54.673549 29205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:54.673652 29205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:54.673692 29205 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:54.673727 29205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:54.675834 29205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:45573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab
--principal=oryx/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:42831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:54.676196 29205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:54.676514 29205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:54.682778 29210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:54.682737 29213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:54.682740 29211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:54.683210 29205 server_base.cc:1034] running on GCE node
I20260806 13:01:54.683493 29205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:54.683830 29205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:54.685058 29205 hybrid_clock.cc:648] HybridClock initialized: now 1786021314685000 us; error 75 us; skew 500 ppm
Aug 06 13:01:54 dist-test-slave-srgv krb5kdc[29084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021314, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:54.688762 29205 init.cc:377] Logged in from keytab as oryx/127.20.245.129@KRBTEST.COM (short username oryx)
I20260806 13:01:54.689388 29205 webserver.cc:460] Webserver started at http://127.20.245.129:42755/ using document root <none> and password file <none>
I20260806 13:01:54.689675 29205 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:54.689755 29205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:54.689942 29205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:54.691488 29205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "0aa13b6399954b51b8234d234053ee2b"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "e8fb84dcf5dfd8e0d1d64061904030fb"
server_key_iv: "f1a6bcc3e1b29468b16099171aa0765d"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.691951 29205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "0aa13b6399954b51b8234d234053ee2b"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "e8fb84dcf5dfd8e0d1d64061904030fb"
server_key_iv: "f1a6bcc3e1b29468b16099171aa0765d"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.693670 29205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:01:54.694621 29220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:54.694921 29205 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:54.695051 29205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "0aa13b6399954b51b8234d234053ee2b"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "e8fb84dcf5dfd8e0d1d64061904030fb"
server_key_iv: "f1a6bcc3e1b29468b16099171aa0765d"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.695256 29205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:54.705302 29205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:54.709095 29205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:54.709381 29205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:54.710186 29205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:54.710264 29205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:54.710309 29205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:54.710361 29205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 13:01:54 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021314, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:54.720419 29205 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:40263
I20260806 13:01:54.720535 29337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:40263 every 8 connection(s)
I20260806 13:01:54.720971 29205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:54.724200 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.710875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:33803 (local address 127.20.245.190:42831)
0806 13:01:54.710958 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:54.710961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:54.711253 (+ 292us) server_negotiation.cc:407] Connection header received
0806 13:01:54.712016 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:54.712018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:54.712038 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:54.712130 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:54.713084 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.713762 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.714983 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.715399 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.715495 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.720538 (+ 5043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:54.720541 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:54.720541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:54.720553 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:54.722358 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.722958 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.722960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.722961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.723046 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.723392 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.723394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.723394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.723556 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:54.723624 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:54.723995 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 13:01:54.724112 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:01:54.724437 29230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.710859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42831 (local address 127.20.245.129:33803)
0806 13:01:54.711061 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:54.711106 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:54.711873 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:54.712317 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:54.712321 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:54.712702 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:54.712953 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:54.712958 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.713879 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.713880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:54.714873 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:54.714876 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.715556 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.715558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:54.715828 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.716728 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:54.716744 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:54.720331 (+ 3587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:54.722491 (+ 2160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:54.722500 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:54.722503 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:54.722834 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:54.723124 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:54.723125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:54.723125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:54.723320 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:54.723654 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:54.723662 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:54.723841 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 13:01:54.723956 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 13:01:54.724158 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":103,"threads_started":1}
I20260806 13:01:54.725173 29338 heartbeater.cc:347] Connected to a master server at 127.20.245.190:42831
I20260806 13:01:54.725296 29338 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:54.725557 29338 heartbeater.cc:511] Master 127.20.245.190:42831 requested a full tablet report, sending...
I20260806 13:01:54.726339 29131 ts_manager.cc:194] Registered new tserver with Master: 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263)
I20260806 13:01:54.726393 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 29205
I20260806 13:01:54.726521 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:54.726850 21462 external_mini_cluster.cc:1428] Setting key c2d1aef6dff5f2cafbfc6a4bba6a1ad1
I20260806 13:01:54.727712 29131 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:33803
I20260806 13:01:54.736434 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.727391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42831 (local address 127.20.245.129:36179)
0806 13:01:54.727599 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:54.727614 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:54.727693 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:54.728167 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:54.728169 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:54.728486 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:54.728623 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:54.728627 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.729538 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.729540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:54.730455 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:54.730459 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.731047 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.731048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:54.731147 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.731937 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:54.731944 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:54.732407 (+ 463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:54.734893 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:54.734895 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:54.734895 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:54.735239 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:54.735553 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:54.735554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:54.735555 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:54.735637 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:54.736037 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:54.736038 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:54.736111 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 13:01:54.736177 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 13:01:54.736318 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":111,"threads_started":1}
I20260806 13:01:54.736485 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.727461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:36179 (local address 127.20.245.190:42831)
0806 13:01:54.728011 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:54.728013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:54.728022 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:01:54.728047 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:54.728048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:54.728062 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:54.728133 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:54.728759 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.729390 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.730585 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.730928 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.731022 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.732524 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:54.732526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:54.732527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:54.732537 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:54.734750 (+ 2213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.735357 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.735360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.735360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.735447 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.735719 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.735720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.735721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.735945 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:54.736036 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:54.736237 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 13:01:54.736353 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522}
WARNING: no policy specified for oryx/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab.
Entry for principal oryx/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab.
I20260806 13:01:54.764473 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42831
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab
--principal=oryx/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:45573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:54.868480 29347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:54.868816 29347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:54.868851 29347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:54.870509 29347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:54.870600 29347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:54.870628 29347 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:54.870651 29347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:54.872823 29347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:45573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab
--principal=oryx/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:42831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:54.873220 29347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:54.873567 29347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:54.880110 29352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:54.880251 29355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:54.880297 29353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:54.881049 29347 server_base.cc:1034] running on GCE node
I20260806 13:01:54.881559 29347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:54.881927 29347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:54.883284 29347 hybrid_clock.cc:648] HybridClock initialized: now 1786021314883260 us; error 50 us; skew 500 ppm
Aug 06 13:01:54 dist-test-slave-srgv krb5kdc[29084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021314, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:54.886829 29347 init.cc:377] Logged in from keytab as oryx/127.20.245.130@KRBTEST.COM (short username oryx)
I20260806 13:01:54.887636 29347 webserver.cc:460] Webserver started at http://127.20.245.130:36223/ using document root <none> and password file <none>
I20260806 13:01:54.887944 29347 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:54.888023 29347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:54.888208 29347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:54.889631 29347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "79b70d682b9a44a898c17363899ae4b3"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "25a88ff53fb741dfd9bcc2360cce90cb"
server_key_iv: "55cefc0275db3dc2d9c6dd2b0cbd06a9"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.890111 29347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "79b70d682b9a44a898c17363899ae4b3"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "25a88ff53fb741dfd9bcc2360cce90cb"
server_key_iv: "55cefc0275db3dc2d9c6dd2b0cbd06a9"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.892452 29347 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 13:01:54.893491 29364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:54.893687 29347 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:54.893817 29347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "79b70d682b9a44a898c17363899ae4b3"
format_stamp: "Formatted at 2026-08-06 13:01:54 on dist-test-slave-srgv"
server_key: "25a88ff53fb741dfd9bcc2360cce90cb"
server_key_iv: "55cefc0275db3dc2d9c6dd2b0cbd06a9"
server_key_version: "encryptionkey@0"
I20260806 13:01:54.893919 29347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:54.916373 29347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:54.919842 29347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:54.920205 29347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:54.921060 29347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:54.921144 29347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:54.921187 29347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:54.921211 29347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 13:01:54 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021314, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:54.930200 29347 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:43157
I20260806 13:01:54.930730 29347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:54.930850 29480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:43157 every 8 connection(s)
I20260806 13:01:54.932891 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 29347
I20260806 13:01:54.933050 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:54.933380 21462 external_mini_cluster.cc:1428] Setting key 0f82a5df159d6bf5f396e81c26e4bae1
I20260806 13:01:54.934877 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.921685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:38073 (local address 127.20.245.190:42831)
0806 13:01:54.921769 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:54.921773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:54.922061 (+ 288us) server_negotiation.cc:407] Connection header received
0806 13:01:54.922888 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:54.922890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:54.922909 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:54.922973 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:54.924131 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.924802 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.926640 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.927055 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.927164 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.930759 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:54.930762 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:54.930762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:54.930775 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:54.932571 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.933359 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.933360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.933361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.933461 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.933876 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.933878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.933878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.934047 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:54.934133 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:54.934624 (+ 491us) server_negotiation.cc:299] Negotiation successful
0806 13:01:54.934753 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 13:01:54.935142 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.921676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42831 (local address 127.20.245.130:38073)
0806 13:01:54.921885 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:54.921939 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:54.922735 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:54.923107 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:54.923115 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:54.923635 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:54.923982 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:54.923990 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.924976 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.924977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:54.926485 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:54.926492 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.927213 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.927216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:54.927417 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.928755 (+ 1338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:54.928765 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:54.930611 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:54.932702 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:54.932714 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:54.932717 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:54.933166 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:54.933560 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:54.933561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:54.933562 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:54.933794 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:54.934133 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:54.934143 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:54.934449 (+ 306us) client_negotiation.cc:769] Sending connection context
0806 13:01:54.934599 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 13:01:54.934831 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":121,"threads_started":1}
I20260806 13:01:54.936968 29481 heartbeater.cc:347] Connected to a master server at 127.20.245.190:42831
I20260806 13:01:54.937115 29481 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:54.937382 29481 heartbeater.cc:511] Master 127.20.245.190:42831 requested a full tablet report, sending...
I20260806 13:01:54.937956 29132 ts_manager.cc:194] Registered new tserver with Master: 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157)
I20260806 13:01:54.938603 29132 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:38073
I20260806 13:01:54.945212 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.937352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42831 (local address 127.20.245.130:56209)
0806 13:01:54.937536 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:54.937552 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:54.937623 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:54.937873 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:54.937874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:54.938212 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:54.938295 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:54.938298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.939258 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.939259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:54.939890 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:54.939892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.940326 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.940327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:54.940405 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.941122 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:54.941128 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:54.941627 (+ 499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:54.943802 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:54.943803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:54.943804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:54.944047 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:54.944296 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:54.944297 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:54.944298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:54.944378 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:54.944768 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:54.944769 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:54.944837 (+ 68us) client_negotiation.cc:769] Sending connection context
0806 13:01:54.944931 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 13:01:54.945083 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":47,"thread_start_us":110,"threads_started":1}
I20260806 13:01:54.945212 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:54.937572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:56209 (local address 127.20.245.190:42831)
0806 13:01:54.937622 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:54.937624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:54.937636 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:01:54.937695 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:54.937696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:54.937709 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:54.937742 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:54.938398 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.939127 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.939989 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:54.940229 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:54.940323 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:54.941773 (+ 1450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:54.941775 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:54.941775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:54.941811 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:54.943665 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.944140 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.944142 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.944143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.944218 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:54.944451 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:54.944452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:54.944452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:54.944682 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:54.944771 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:54.944970 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 13:01:54.945092 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
WARNING: no policy specified for oryx/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab.
Entry for principal oryx/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab.
I20260806 13:01:54.976878 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:42831
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab
--principal=oryx/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:45573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:55.085408 29490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:55.085705 29490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:55.085740 29490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:55.087153 29490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:55.087311 29490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:55.087338 29490 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 13:01:55.087359 29490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:55.089325 29490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:45573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab
--principal=oryx/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.245.190:42831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:55.089630 29490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:55.089919 29490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:55.096607 29495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:55.096596 29496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:55.096587 29498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:55.097074 29490 server_base.cc:1034] running on GCE node
I20260806 13:01:55.097481 29490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:55.097918 29490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:55.099097 29490 hybrid_clock.cc:648] HybridClock initialized: now 1786021315099068 us; error 91 us; skew 500 ppm
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021315, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:55.102931 29490 init.cc:377] Logged in from keytab as oryx/127.20.245.131@KRBTEST.COM (short username oryx)
I20260806 13:01:55.103745 29490 webserver.cc:460] Webserver started at http://127.20.245.131:45731/ using document root <none> and password file <none>
I20260806 13:01:55.104074 29490 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:55.104156 29490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:55.104353 29490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:55.105775 29490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "ee502c0d7f864b34b70ac04aa5d393f4"
format_stamp: "Formatted at 2026-08-06 13:01:55 on dist-test-slave-srgv"
server_key: "bdbdcbf329ba092c3793b9c09b6eb29a"
server_key_iv: "bdcfb5342b015332d36ec854203df21c"
server_key_version: "encryptionkey@0"
I20260806 13:01:55.106251 29490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "ee502c0d7f864b34b70ac04aa5d393f4"
format_stamp: "Formatted at 2026-08-06 13:01:55 on dist-test-slave-srgv"
server_key: "bdbdcbf329ba092c3793b9c09b6eb29a"
server_key_iv: "bdcfb5342b015332d36ec854203df21c"
server_key_version: "encryptionkey@0"
I20260806 13:01:55.108065 29490 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260806 13:01:55.109081 29506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:55.109326 29490 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:55.109454 29490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "ee502c0d7f864b34b70ac04aa5d393f4"
format_stamp: "Formatted at 2026-08-06 13:01:55 on dist-test-slave-srgv"
server_key: "bdbdcbf329ba092c3793b9c09b6eb29a"
server_key_iv: "bdcfb5342b015332d36ec854203df21c"
server_key_version: "encryptionkey@0"
I20260806 13:01:55.109550 29490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:55.137748 29490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:55.140828 29490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:55.141050 29490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:55.141790 29490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:55.141870 29490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:55.141924 29490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:55.141957 29490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021315, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:55.151841 29490 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:42337
I20260806 13:01:55.152199 29622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:42337 every 8 connection(s)
I20260806 13:01:55.152438 29490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:55.154307 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.142541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:51047 (local address 127.20.245.190:42831)
0806 13:01:55.142657 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.142660 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.142914 (+ 254us) server_negotiation.cc:407] Connection header received
0806 13:01:55.143665 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.143666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.143684 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.143755 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:55.144942 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.145937 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.147477 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.147769 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.147864 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.150880 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:55.150882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:55.150883 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:55.150894 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:55.152860 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.153402 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.153404 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.153404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.153468 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.153677 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.153678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.153678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.153805 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:55.153852 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.154147 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.154227 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 13:01:55.154469 29515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.142515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42831 (local address 127.20.245.131:51047)
0806 13:01:55.142768 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.142818 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.143529 (+ 711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.143855 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.143859 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.144406 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:55.144798 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.144808 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.146121 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.146123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.147356 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.147361 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.147890 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.147891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.148060 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.148929 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:55.148941 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:55.150735 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:55.152954 (+ 2219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:55.152958 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:55.152960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:55.153324 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:55.153541 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:55.153541 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:55.153542 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:55.153640 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:55.153845 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:55.153849 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:55.153986 (+ 137us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.154073 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.154232 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":170,"threads_started":1}
I20260806 13:01:55.155050 29623 heartbeater.cc:347] Connected to a master server at 127.20.245.190:42831
I20260806 13:01:55.155169 29623 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:55.155467 29623 heartbeater.cc:511] Master 127.20.245.190:42831 requested a full tablet report, sending...
I20260806 13:01:55.155591 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 29490
I20260806 13:01:55.155704 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:55.155961 21462 external_mini_cluster.cc:1428] Setting key 9797e1d9039023061db993eab14498b0
I20260806 13:01:55.155993 29131 ts_manager.cc:194] Registered new tserver with Master: ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:55.156574 29131 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:51047
I20260806 13:01:55.156901 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:01:55.163882 29629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.156376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42831 (local address 127.20.245.131:58807)
0806 13:01:55.156571 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.156594 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.156667 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.156872 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.156874 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.157140 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:55.157215 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.157218 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.158177 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.158178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.158704 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.158706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.159249 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.159250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.159336 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.159941 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:55.159947 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:55.160444 (+ 497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:55.162511 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:55.162513 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:55.162514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:55.162799 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:55.163033 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:55.163034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:55.163034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:55.163110 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:55.163540 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:55.163541 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:55.163599 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.163662 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.163786 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":86,"threads_started":1}
I20260806 13:01:55.163995 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.156446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:58807 (local address 127.20.245.190:42831)
0806 13:01:55.156489 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.156492 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.156716 (+ 224us) server_negotiation.cc:407] Connection header received
0806 13:01:55.156748 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.156749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.156761 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.156818 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:55.157309 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.158070 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.158800 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.159119 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.159226 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.160562 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:55.160563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:55.160564 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:55.160572 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:55.162387 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.162889 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.162890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.162891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.162952 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.163221 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.163222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.163223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.163438 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:55.163531 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.163728 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.163845 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021315, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 13:01:55.186020 29183 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:55.178836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58832 (local address 127.20.245.190:42831)
0806 13:01:55.178919 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.178921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.178931 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:01:55.178965 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.178966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.178978 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.179033 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:55.179846 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.180429 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.181287 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.181525 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.181745 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.185874 (+ 4129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58832: BlockingRecv error: recv got EOF from 127.0.0.1:58832 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021315, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:55.195775 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.187102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.20.245.190:42831)
0806 13:01:55.187208 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.187211 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.187418 (+ 207us) server_negotiation.cc:407] Connection header received
0806 13:01:55.187528 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.187529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.187543 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.187604 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:55.188161 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.188752 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.189504 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.189724 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.189814 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.192657 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:55.192660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:55.192661 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:55.192673 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:55.194311 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.194772 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.194773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.194773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.194835 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.195052 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.195053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.195053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.195272 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:55.195401 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.195523 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.195633 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:01:55.198310 29132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:55.200562 29132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:55.208655 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.203871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40352 (local address 127.20.245.129:40263)
0806 13:01:55.204403 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.204408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.204422 (+ 14us) server_negotiation.cc:407] Connection header received
0806 13:01:55.204480 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.204483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.204502 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.204601 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:55.204785 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.205709 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.207094 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.207948 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.208035 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.208110 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.208459 (+ 349us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.208518 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260806 13:01:55.209012 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.203761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:42337 (local address 127.0.0.1:51630)
0806 13:01:55.204325 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.204337 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.204393 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.204820 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.204821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.204824 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:55.204875 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.204876 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.206316 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.206317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.207555 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.207558 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.208655 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.208657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.208737 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.208742 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.208792 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.208908 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":18,"thread_start_us":111,"threads_started":1}
I20260806 13:01:55.209074 29647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.203705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40263 (local address 127.0.0.1:40352)
0806 13:01:55.204093 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.204148 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.204242 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.204610 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.204614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.204616 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:55.204713 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.204715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.205812 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.205814 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.206973 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.206977 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.208183 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.208184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.208300 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.208322 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.208860 (+ 538us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.208955 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":26,"thread_start_us":139,"threads_started":1}
I20260806 13:01:55.209442 29650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.203988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.20.245.131:42337)
0806 13:01:55.204266 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.204273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.204446 (+ 173us) server_negotiation.cc:407] Connection header received
0806 13:01:55.204501 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.204503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.204517 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.204612 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:55.204970 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.206156 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.207658 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.208447 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.208551 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.208612 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.209254 (+ 642us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.209320 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":104,"threads_started":1}
I20260806 13:01:55.210029 29271 tablet_service.cc:1467] Processing CreateTablet for tablet d7665dbe4271499d939da8f7972ade3d (DEFAULT_TABLE table=test-table [id=281aa86b474f4cffaeb85b533eb90e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.210139 29556 tablet_service.cc:1467] Processing CreateTablet for tablet d7665dbe4271499d939da8f7972ade3d (DEFAULT_TABLE table=test-table [id=281aa86b474f4cffaeb85b533eb90e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.210561 29271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7665dbe4271499d939da8f7972ade3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.210585 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7665dbe4271499d939da8f7972ade3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.214275 29653 tablet_bootstrap.cc:492] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: Bootstrap starting.
I20260806 13:01:55.215273 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.204037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:43157 (local address 127.0.0.1:34110)
0806 13:01:55.204721 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.204730 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.204805 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.205005 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.205006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.205008 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:55.205054 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.205056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.206489 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.206490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.207762 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.207764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.214844 (+ 7080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.214846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.214983 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.214989 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.215068 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.215146 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":113,"threads_started":1}
I20260806 13:01:55.215389 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.204193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34110 (local address 127.20.245.130:43157)
0806 13:01:55.204694 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.204699 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.204826 (+ 127us) server_negotiation.cc:407] Connection header received
0806 13:01:55.204885 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.204887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.204905 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.204996 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:55.205117 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.206328 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.207869 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.208678 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.209409 (+ 731us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.214742 (+ 5333us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.215116 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.215247 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":99,"threads_started":1}
I20260806 13:01:55.215477 29653 tablet_bootstrap.cc:654] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.215723 29654 tablet_bootstrap.cc:492] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Bootstrap starting.
I20260806 13:01:55.216233 29414 tablet_service.cc:1467] Processing CreateTablet for tablet d7665dbe4271499d939da8f7972ade3d (DEFAULT_TABLE table=test-table [id=281aa86b474f4cffaeb85b533eb90e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.216406 29654 tablet_bootstrap.cc:654] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.216694 29414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7665dbe4271499d939da8f7972ade3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.216805 29654 log.cc:824] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:55.217777 29654 tablet_bootstrap.cc:492] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: No bootstrap required, opened a new log
I20260806 13:01:55.217902 29654 ts_tablet_manager.cc:1397] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:01:55.219578 29653 log.cc:824] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:55.220081 29654 raft_consensus.cc:348] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.220293 29654 raft_consensus.cc:374] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.220341 29654 raft_consensus.cc:729] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee502c0d7f864b34b70ac04aa5d393f4, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.220523 29654 consensus_queue.cc:260] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.220703 29653 tablet_bootstrap.cc:492] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: No bootstrap required, opened a new log
I20260806 13:01:55.220791 29653 ts_tablet_manager.cc:1397] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260806 13:01:55.220847 29654 ts_tablet_manager.cc:1428] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:01:55.220993 29623 heartbeater.cc:503] Master 127.20.245.190:42831 was elected leader, sending a full tablet report...
I20260806 13:01:55.221352 29658 tablet_bootstrap.cc:492] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: Bootstrap starting.
I20260806 13:01:55.222177 29658 tablet_bootstrap.cc:654] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.222538 29658 log.cc:824] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:55.223309 29653 raft_consensus.cc:348] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.223486 29653 raft_consensus.cc:374] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.223511 29653 raft_consensus.cc:729] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa13b6399954b51b8234d234053ee2b, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.223523 29658 tablet_bootstrap.cc:492] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: No bootstrap required, opened a new log
I20260806 13:01:55.223614 29658 ts_tablet_manager.cc:1397] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:55.223693 29653 consensus_queue.cc:260] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.224049 29653 ts_tablet_manager.cc:1428] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 13:01:55.224138 29338 heartbeater.cc:503] Master 127.20.245.190:42831 was elected leader, sending a full tablet report...
I20260806 13:01:55.226013 29658 raft_consensus.cc:348] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.226220 29658 raft_consensus.cc:374] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.226261 29658 raft_consensus.cc:729] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b70d682b9a44a898c17363899ae4b3, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.226401 29658 consensus_queue.cc:260] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.226696 29658 ts_tablet_manager.cc:1428] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 13:01:55.226764 29481 heartbeater.cc:503] Master 127.20.245.190:42831 was elected leader, sending a full tablet report...
I20260806 13:01:55.363394 29660 raft_consensus.cc:482] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:55.363592 29660 raft_consensus.cc:504] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.364167 29660 leader_election.cc:288] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:55.367815 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.364447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:42337 (local address 127.20.245.129:37205)
0806 13:01:55.364669 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.364686 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.364794 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.365000 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.365001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.365005 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:55.365110 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.365113 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.365884 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.365886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.366855 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.366858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.367522 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.367523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.367606 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.367612 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.367670 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.367723 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":51,"thread_start_us":124,"threads_started":1}
I20260806 13:01:55.367952 29650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.364647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:37205 (local address 127.20.245.131:42337)
0806 13:01:55.364732 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.364734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.364768 (+ 34us) server_negotiation.cc:407] Connection header received
0806 13:01:55.364886 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.364887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.364902 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.364973 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:55.365194 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.365787 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.366960 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.367428 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.367493 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.367504 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.367803 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.367867 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 13:01:55.368048 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.364626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:45053 (local address 127.20.245.130:43157)
0806 13:01:55.364686 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.364689 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.364990 (+ 301us) server_negotiation.cc:407] Connection header received
0806 13:01:55.365028 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.365030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.365045 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.365111 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:55.365297 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.365798 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.366959 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.367508 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.367585 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.367597 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.367906 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.367964 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 13:01:55.368026 29663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.364446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:43157 (local address 127.20.245.129:45053)
0806 13:01:55.364873 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.364886 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.364963 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.365129 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.365130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.365132 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:55.365216 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.365218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.365928 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.365928 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.366854 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.366856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.367620 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.367621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.367815 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.367822 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.367882 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.367931 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":43,"thread_start_us":266,"threads_started":1}
I20260806 13:01:55.368846 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7665dbe4271499d939da8f7972ade3d" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" is_pre_election: true
I20260806 13:01:55.368882 29434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7665dbe4271499d939da8f7972ade3d" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b70d682b9a44a898c17363899ae4b3" is_pre_election: true
I20260806 13:01:55.369084 29434 raft_consensus.cc:2454] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 0.
I20260806 13:01:55.369086 29574 raft_consensus.cc:2454] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 0.
I20260806 13:01:55.369431 29222 leader_election.cc:302] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa13b6399954b51b8234d234053ee2b, ee502c0d7f864b34b70ac04aa5d393f4; no voters:
I20260806 13:01:55.369642 29660 raft_consensus.cc:2781] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:55.369714 29660 raft_consensus.cc:482] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:55.369757 29660 raft_consensus.cc:3037] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.370728 29660 raft_consensus.cc:504] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.370930 29660 leader_election.cc:288] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 election: Requested vote from peers 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:55.371223 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7665dbe4271499d939da8f7972ade3d" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4"
I20260806 13:01:55.371235 29434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7665dbe4271499d939da8f7972ade3d" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b70d682b9a44a898c17363899ae4b3"
I20260806 13:01:55.371340 29434 raft_consensus.cc:3037] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.371341 29574 raft_consensus.cc:3037] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.372546 29574 raft_consensus.cc:2454] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 1.
I20260806 13:01:55.372537 29434 raft_consensus.cc:2454] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 1.
I20260806 13:01:55.372797 29222 leader_election.cc:302] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa13b6399954b51b8234d234053ee2b, ee502c0d7f864b34b70ac04aa5d393f4; no voters:
I20260806 13:01:55.372929 29660 raft_consensus.cc:2781] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:55.373131 29660 raft_consensus.cc:686] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 1 LEADER]: Becoming Leader. State: Replica: 0aa13b6399954b51b8234d234053ee2b, State: Running, Role: LEADER
I20260806 13:01:55.373308 29660 consensus_queue.cc:237] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.374929 29131 catalog_manager.cc:5495] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa13b6399954b51b8234d234053ee2b (127.20.245.129). New cstate: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:55.399806 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.396768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40356 (local address 127.20.245.129:40263)
0806 13:01:55.396850 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.396852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.396860 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:01:55.396912 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.396913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.396938 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.397033 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:55.397257 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.397849 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.398731 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.398999 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.399122 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.399360 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:55.399507 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:55.399608 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.399649 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.399679 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 13:01:55.402714 29434 raft_consensus.cc:1261] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa13b6399954b51b8234d234053ee2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:55.402714 29574 raft_consensus.cc:1261] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Refusing update from remote peer 0aa13b6399954b51b8234d234053ee2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260806 13:01:55.403136 29624 tablet.cc:2369] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:55.403340 29664 consensus_queue.cc:1035] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:55.403568 29660 consensus_queue.cc:1035] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:55.407522 29669 mvcc.cc:205] Tried to move back new op lower bound from 7315543307884855296 to 7315543307770241024. Current Snapshot: MvccSnapshot[applied={T|T < 7315543307884855296}]
I20260806 13:01:55.407801 29668 mvcc.cc:205] Tried to move back new op lower bound from 7315543307884855296 to 7315543307770241024. Current Snapshot: MvccSnapshot[applied={T|T < 7315543307884855296}]
I20260806 13:01:55.410475 29131 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:55.410642 29131 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:55.411756 29131 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: Sending DeleteTablet for 3 replicas of tablet d7665dbe4271499d939da8f7972ade3d
I20260806 13:01:55.412274 29271 tablet_service.cc:1514] Processing DeleteTablet for tablet d7665dbe4271499d939da8f7972ade3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:55 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:40352
I20260806 13:01:55.412544 29556 tablet_service.cc:1514] Processing DeleteTablet for tablet d7665dbe4271499d939da8f7972ade3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:55 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:51630
I20260806 13:01:55.412634 29414 tablet_service.cc:1514] Processing DeleteTablet for tablet d7665dbe4271499d939da8f7972ade3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:55 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34110
I20260806 13:01:55.412695 29131 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 13:01:55.412904 29677 tablet_replica.cc:330] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: stopping tablet replica
W20260806 13:01:55.412925 29131 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:55.413040 29677 raft_consensus.cc:2229] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:55.413178 29677 raft_consensus.cc:2258] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:55.413210 29678 tablet_replica.cc:330] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: stopping tablet replica
I20260806 13:01:55.413424 29678 raft_consensus.cc:2229] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:55.413703 29678 raft_consensus.cc:2258] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:55.414312 29678 ts_tablet_manager.cc:1905] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:55.414911 29271 tablet_service.cc:1467] Processing CreateTablet for tablet 1044de93e7e24f91b159f7a23a6cfcab (DEFAULT_TABLE table=test-table [id=b013bb79ba1a4082850f8afcb13c3dd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.414958 29414 tablet_service.cc:1467] Processing CreateTablet for tablet 1044de93e7e24f91b159f7a23a6cfcab (DEFAULT_TABLE table=test-table [id=b013bb79ba1a4082850f8afcb13c3dd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.415099 29271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1044de93e7e24f91b159f7a23a6cfcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.415139 29414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1044de93e7e24f91b159f7a23a6cfcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.416534 29653 tablet_bootstrap.cc:492] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: Bootstrap starting.
I20260806 13:01:55.416635 29678 ts_tablet_manager.cc:1918] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:55.416725 29678 log.cc:1196] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/d7665dbe4271499d939da8f7972ade3d
I20260806 13:01:55.417054 29678 ts_tablet_manager.cc:1939] T d7665dbe4271499d939da8f7972ade3d P ee502c0d7f864b34b70ac04aa5d393f4: Deleting consensus metadata
I20260806 13:01:55.417047 29658 tablet_bootstrap.cc:492] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: Bootstrap starting.
I20260806 13:01:55.417081 29653 tablet_bootstrap.cc:654] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.417763 29115 catalog_manager.cc:4841] TS ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337): tablet d7665dbe4271499d939da8f7972ade3d (table test-table [id=281aa86b474f4cffaeb85b533eb90e49]) successfully deleted
I20260806 13:01:55.417905 29658 tablet_bootstrap.cc:654] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.417941 29556 tablet_service.cc:1467] Processing CreateTablet for tablet 1044de93e7e24f91b159f7a23a6cfcab (DEFAULT_TABLE table=test-table [id=b013bb79ba1a4082850f8afcb13c3dd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.418076 29653 tablet_bootstrap.cc:492] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: No bootstrap required, opened a new log
I20260806 13:01:55.418087 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1044de93e7e24f91b159f7a23a6cfcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.418131 29653 ts_tablet_manager.cc:1397] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:55.418329 29653 raft_consensus.cc:348] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.418438 29653 raft_consensus.cc:374] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.418458 29653 raft_consensus.cc:729] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa13b6399954b51b8234d234053ee2b, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.418512 29653 consensus_queue.cc:260] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.418604 29653 ts_tablet_manager.cc:1428] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 13:01:55.418908 29658 tablet_bootstrap.cc:492] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: No bootstrap required, opened a new log
I20260806 13:01:55.418962 29658 ts_tablet_manager.cc:1397] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 13:01:55.419153 29658 raft_consensus.cc:348] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.419273 29658 raft_consensus.cc:374] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.419296 29658 raft_consensus.cc:729] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b70d682b9a44a898c17363899ae4b3, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.419348 29658 consensus_queue.cc:260] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.419458 29658 ts_tablet_manager.cc:1428] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:55.419840 29654 tablet_bootstrap.cc:492] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: Bootstrap starting.
I20260806 13:01:55.420111 29677 ts_tablet_manager.cc:1905] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:55.420346 29654 tablet_bootstrap.cc:654] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.421185 29654 tablet_bootstrap.cc:492] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: No bootstrap required, opened a new log
I20260806 13:01:55.421257 29654 ts_tablet_manager.cc:1397] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:55.421476 29654 raft_consensus.cc:348] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.421581 29654 raft_consensus.cc:374] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.421607 29654 raft_consensus.cc:729] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee502c0d7f864b34b70ac04aa5d393f4, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.421655 29654 consensus_queue.cc:260] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.421761 29654 ts_tablet_manager.cc:1428] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 13:01:55.422483 29677 ts_tablet_manager.cc:1918] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:55.422606 29677 log.cc:1196] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/d7665dbe4271499d939da8f7972ade3d
I20260806 13:01:55.422925 29677 ts_tablet_manager.cc:1939] T d7665dbe4271499d939da8f7972ade3d P 0aa13b6399954b51b8234d234053ee2b: Deleting consensus metadata
I20260806 13:01:55.423604 29117 catalog_manager.cc:4841] TS 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263): tablet d7665dbe4271499d939da8f7972ade3d (table test-table [id=281aa86b474f4cffaeb85b533eb90e49]) successfully deleted
I20260806 13:01:55.427513 29679 tablet_replica.cc:330] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: stopping tablet replica
I20260806 13:01:55.427790 29679 raft_consensus.cc:2229] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:55.428009 29679 raft_consensus.cc:2258] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:55.428707 29679 ts_tablet_manager.cc:1905] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:55.430652 29679 ts_tablet_manager.cc:1918] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:55.430733 29679 log.cc:1196] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/d7665dbe4271499d939da8f7972ade3d
I20260806 13:01:55.431023 29679 ts_tablet_manager.cc:1939] T d7665dbe4271499d939da8f7972ade3d P 79b70d682b9a44a898c17363899ae4b3: Deleting consensus metadata
W20260806 13:01:55.431734 29482 tablet.cc:2369] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:01:55.432058 29117 catalog_manager.cc:4841] TS 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157): tablet d7665dbe4271499d939da8f7972ade3d (table test-table [id=281aa86b474f4cffaeb85b533eb90e49]) successfully deleted
I20260806 13:01:55.443445 29661 raft_consensus.cc:482] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:55.443625 29661 raft_consensus.cc:504] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.444139 29661 leader_election.cc:288] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:55.448825 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.444627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:44439 (local address 127.20.245.129:40263)
0806 13:01:55.444711 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.444714 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.444730 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:01:55.444879 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.444881 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.444893 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.444954 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:55.445249 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.445851 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.447671 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.448326 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.448411 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.448422 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.448662 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.448723 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 13:01:55.448825 29650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.444591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:33227 (local address 127.20.245.131:42337)
0806 13:01:55.444656 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.444658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.444809 (+ 151us) server_negotiation.cc:407] Connection header received
0806 13:01:55.444874 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.444875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.444889 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.444950 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:01:55.445191 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.446007 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.447668 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.448270 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.448319 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.448329 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.448661 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.448723 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 13:01:55.449172 29684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.444385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:42337 (local address 127.20.245.130:33227)
0806 13:01:55.444706 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.444715 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.444793 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.444973 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.444974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.444977 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:55.445102 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.445104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.446100 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.446101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.447515 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.447520 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.448424 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.448424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.448547 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.448554 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.448959 (+ 405us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.449044 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":7,"thread_start_us":82,"threads_started":1}
I20260806 13:01:55.449460 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1044de93e7e24f91b159f7a23a6cfcab" candidate_uuid: "79b70d682b9a44a898c17363899ae4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" is_pre_election: true
I20260806 13:01:55.449599 29683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.444377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40263 (local address 127.20.245.130:44439)
0806 13:01:55.444651 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.444666 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.444756 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.445034 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.445036 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.445038 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:01:55.445184 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.445186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.445953 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.445954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.447515 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.447520 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.448422 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.448423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.448547 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.448555 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.449446 (+ 891us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.449515 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":95,"thread_start_us":90,"threads_started":1}
I20260806 13:01:55.449605 29574 raft_consensus.cc:2454] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b70d682b9a44a898c17363899ae4b3 in term 0.
I20260806 13:01:55.449842 29365 leader_election.cc:302] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b70d682b9a44a898c17363899ae4b3, ee502c0d7f864b34b70ac04aa5d393f4; no voters:
I20260806 13:01:55.450007 29661 raft_consensus.cc:2781] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:55.450052 29661 raft_consensus.cc:482] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:55.450088 29661 raft_consensus.cc:3037] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.450970 29661 raft_consensus.cc:504] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.451256 29661 leader_election.cc:288] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:55.451323 29292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1044de93e7e24f91b159f7a23a6cfcab" candidate_uuid: "79b70d682b9a44a898c17363899ae4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa13b6399954b51b8234d234053ee2b" is_pre_election: true
I20260806 13:01:55.451468 29291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1044de93e7e24f91b159f7a23a6cfcab" candidate_uuid: "79b70d682b9a44a898c17363899ae4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa13b6399954b51b8234d234053ee2b"
I20260806 13:01:55.451575 29291 raft_consensus.cc:3037] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.451961 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1044de93e7e24f91b159f7a23a6cfcab" candidate_uuid: "79b70d682b9a44a898c17363899ae4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4"
I20260806 13:01:55.452054 29574 raft_consensus.cc:3037] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.452661 29291 raft_consensus.cc:2454] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b70d682b9a44a898c17363899ae4b3 in term 1.
I20260806 13:01:55.452903 29367 leader_election.cc:302] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa13b6399954b51b8234d234053ee2b, 79b70d682b9a44a898c17363899ae4b3; no voters:
I20260806 13:01:55.453029 29661 raft_consensus.cc:2781] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:55.453153 29574 raft_consensus.cc:2454] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b70d682b9a44a898c17363899ae4b3 in term 1.
I20260806 13:01:55.453200 29661 raft_consensus.cc:686] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 79b70d682b9a44a898c17363899ae4b3, State: Running, Role: LEADER
I20260806 13:01:55.453289 29661 consensus_queue.cc:237] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.454296 29131 catalog_manager.cc:5495] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130). New cstate: current_term: 1 leader_uuid: "79b70d682b9a44a898c17363899ae4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } health_report { overall_health: UNKNOWN } } }
W20260806 13:01:55.472244 29339 tablet.cc:2369] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021314, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.190@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:55.493304 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.481079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58846 (local address 127.20.245.190:42831)
0806 13:01:55.481199 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.481202 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.481474 (+ 272us) server_negotiation.cc:407] Connection header received
0806 13:01:55.481573 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.481574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.481586 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.481672 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:55.482599 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.483577 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.484853 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.485213 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.485341 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.488854 (+ 3513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:55.488857 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:55.488858 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:55.488867 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:55.491679 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.492255 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.492256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.492257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.492337 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.492575 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.492576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.492576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.492726 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:55.492820 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.493004 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.493172 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 13:01:55.493399 29692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.481016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:42831 (local address 127.0.0.1:58846)
0806 13:01:55.481356 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.481368 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.481486 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.481679 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.481680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.482366 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:55.482474 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.482478 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.483693 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.483694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.484717 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.484720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.485342 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.485343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.485454 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.486309 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:55.486317 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:55.488712 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:55.491826 (+ 3114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:55.491834 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:55.491836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:55.492149 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:55.492417 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:55.492418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:55.492419 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:55.492484 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:55.492807 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:55.492816 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:55.492872 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.492964 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.493251 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":135,"thread_start_us":130,"threads_started":1}
I20260806 13:01:55.497275 29131 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:58846:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 13:01:55.497643 29131 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:55.499801 29414 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef328d0fe6a46ad90f6d815836beefc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d4313e11008b412daeeddde237fd3588]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:55.499835 29556 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef328d0fe6a46ad90f6d815836beefc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d4313e11008b412daeeddde237fd3588]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:55.500070 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef328d0fe6a46ad90f6d815836beefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.500072 29414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef328d0fe6a46ad90f6d815836beefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.502827 29658 tablet_bootstrap.cc:492] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: Bootstrap starting.
I20260806 13:01:55.502954 29271 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef328d0fe6a46ad90f6d815836beefc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d4313e11008b412daeeddde237fd3588]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 13:01:55.503350 29271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef328d0fe6a46ad90f6d815836beefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.503530 29658 tablet_bootstrap.cc:654] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.504534 29658 tablet_bootstrap.cc:492] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: No bootstrap required, opened a new log
I20260806 13:01:55.504603 29658 ts_tablet_manager.cc:1397] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 13:01:55.504871 29658 raft_consensus.cc:348] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.504978 29658 raft_consensus.cc:374] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.505023 29658 raft_consensus.cc:729] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b70d682b9a44a898c17363899ae4b3, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.505086 29658 consensus_queue.cc:260] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.505214 29658 ts_tablet_manager.cc:1428] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:55.505393 29661 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.505478 29661 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:55.505661 29653 tablet_bootstrap.cc:492] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: Bootstrap starting.
I20260806 13:01:55.506124 29653 tablet_bootstrap.cc:654] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.506744 29654 tablet_bootstrap.cc:492] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: Bootstrap starting.
I20260806 13:01:55.507483 29653 tablet_bootstrap.cc:492] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: No bootstrap required, opened a new log
I20260806 13:01:55.507474 29654 tablet_bootstrap.cc:654] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.507539 29653 ts_tablet_manager.cc:1397] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:55.507820 29653 raft_consensus.cc:348] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.507934 29653 raft_consensus.cc:374] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.507956 29653 raft_consensus.cc:729] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa13b6399954b51b8234d234053ee2b, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.508037 29653 consensus_queue.cc:260] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.508162 29653 ts_tablet_manager.cc:1428] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:55.508191 29675 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.508291 29675 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:55.508870 29654 tablet_bootstrap.cc:492] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: No bootstrap required, opened a new log
I20260806 13:01:55.508945 29654 ts_tablet_manager.cc:1397] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:55.509168 29654 raft_consensus.cc:348] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.509271 29654 raft_consensus.cc:374] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.509300 29654 raft_consensus.cc:729] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee502c0d7f864b34b70ac04aa5d393f4, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.509356 29654 consensus_queue.cc:260] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.509464 29654 ts_tablet_manager.cc:1428] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 13:01:55.509677 29657 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.509795 29657 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:55.541445 29675 raft_consensus.cc:482] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:55.541638 29675 raft_consensus.cc:504] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.541955 29675 leader_election.cc:288] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:55.542343 29434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef328d0fe6a46ad90f6d815836beefc" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b70d682b9a44a898c17363899ae4b3" is_pre_election: true
I20260806 13:01:55.542357 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef328d0fe6a46ad90f6d815836beefc" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" is_pre_election: true
I20260806 13:01:55.542514 29434 raft_consensus.cc:2454] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 0.
I20260806 13:01:55.542536 29574 raft_consensus.cc:2454] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 0.
I20260806 13:01:55.542784 29224 leader_election.cc:302] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa13b6399954b51b8234d234053ee2b, 79b70d682b9a44a898c17363899ae4b3; no voters:
I20260806 13:01:55.542997 29675 raft_consensus.cc:2781] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:55.543053 29675 raft_consensus.cc:482] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:55.543079 29675 raft_consensus.cc:3037] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.544972 29675 raft_consensus.cc:504] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.545202 29675 leader_election.cc:288] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 election: Requested vote from peers 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:55.545490 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef328d0fe6a46ad90f6d815836beefc" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4"
I20260806 13:01:55.545622 29574 raft_consensus.cc:3037] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.545753 29434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef328d0fe6a46ad90f6d815836beefc" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b70d682b9a44a898c17363899ae4b3"
I20260806 13:01:55.545871 29434 raft_consensus.cc:3037] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:55.546862 29574 raft_consensus.cc:2454] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 1.
I20260806 13:01:55.546991 29434 raft_consensus.cc:2454] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 1.
I20260806 13:01:55.547147 29222 leader_election.cc:302] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa13b6399954b51b8234d234053ee2b, ee502c0d7f864b34b70ac04aa5d393f4; no voters:
I20260806 13:01:55.547821 29675 raft_consensus.cc:2781] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:55.548208 29675 raft_consensus.cc:686] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [term 1 LEADER]: Becoming Leader. State: Replica: 0aa13b6399954b51b8234d234053ee2b, State: Running, Role: LEADER
I20260806 13:01:55.548430 29675 consensus_queue.cc:237] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.549485 29664 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: TxnStatusTablet state changed. Reason: New leader 0aa13b6399954b51b8234d234053ee2b. Latest consensus state: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.549654 29664 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:55.549888 29697 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 13:01:55.550040 29697 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 13:01:55.550573 29132 catalog_manager.cc:5495] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa13b6399954b51b8234d234053ee2b (127.20.245.129). New cstate: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:55.564417 29692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.560942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40263 (local address 127.0.0.1:40366)
0806 13:01:55.561148 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.561165 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.561246 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.561416 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.561417 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.561419 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:55.561524 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.561528 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.562251 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.562252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.563239 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.563244 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.563825 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.563826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.563913 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.563941 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:55.564203 (+ 262us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:55.564212 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.564258 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.564325 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260806 13:01:55.564499 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.561038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40366 (local address 127.20.245.129:40263)
0806 13:01:55.561124 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.561126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.561253 (+ 127us) server_negotiation.cc:407] Connection header received
0806 13:01:55.561335 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.561336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.561350 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.561408 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:55.561592 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.562129 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.563354 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.563686 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.563778 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.564050 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:55.564100 (+ 50us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:55.564160 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.564372 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.564411 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 13:01:55.566542 29574 raft_consensus.cc:1261] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Refusing update from remote peer 0aa13b6399954b51b8234d234053ee2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:55.566847 29434 raft_consensus.cc:1261] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa13b6399954b51b8234d234053ee2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:55.566987 29664 consensus_queue.cc:1035] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:55.567160 29675 consensus_queue.cc:1035] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:55.568315 29661 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: TxnStatusTablet state changed. Reason: New leader 0aa13b6399954b51b8234d234053ee2b. Latest consensus state: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.568322 29657 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: TxnStatusTablet state changed. Reason: New leader 0aa13b6399954b51b8234d234053ee2b. Latest consensus state: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.568457 29661 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:55.568486 29657 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:55.569418 29667 mvcc.cc:205] Tried to move back new op lower bound from 7315543308557443072 to 7315543308487811072. Current Snapshot: MvccSnapshot[applied={T|T < 7315543308557443072}]
I20260806 13:01:55.569929 29660 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.570065 29660 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:55.570608 29661 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.570725 29661 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P 79b70d682b9a44a898c17363899ae4b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:55.571756 29664 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.571888 29664 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P 0aa13b6399954b51b8234d234053ee2b: This TxnStatusTablet replica's current role is: LEADER
I20260806 13:01:55.572382 29657 tablet_replica.cc:439] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } } }
I20260806 13:01:55.572503 29657 tablet_replica.cc:442] T 5ef328d0fe6a46ad90f6d815836beefc P ee502c0d7f864b34b70ac04aa5d393f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 13:01:55.575078 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.572043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34118 (local address 127.20.245.130:43157)
0806 13:01:55.572107 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.572110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.572120 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:01:55.572172 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.572173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.572203 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.572288 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:55.572479 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.573236 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.574021 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.574307 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.574397 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.574619 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:55.574780 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:55.574870 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.574952 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.574984 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 13:01:55.582397 29703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.578895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40263 (local address 127.20.245.130:47555)
0806 13:01:55.579100 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.579113 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.579259 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.579422 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.579423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.579425 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:55.579511 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.579513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.580532 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.580534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.581270 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.581273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.581799 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.581800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.581943 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.581971 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:55.582191 (+ 220us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:55.582194 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.582237 (+ 43us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.582292 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":122,"threads_started":1}
I20260806 13:01:55.582384 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.579005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:47555 (local address 127.20.245.129:40263)
0806 13:01:55.579066 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.579068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.579217 (+ 149us) server_negotiation.cc:407] Connection header received
0806 13:01:55.579333 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.579334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.579351 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.579405 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:55.579580 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.580368 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.581370 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.581689 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.581770 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.582075 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:55.582122 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:55.582176 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.582242 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.582276 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 13:01:55.586571 29574 raft_consensus.cc:1261] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Refusing update from remote peer 79b70d682b9a44a898c17363899ae4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:55.586637 29291 raft_consensus.cc:1261] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Refusing update from remote peer 79b70d682b9a44a898c17363899ae4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:55.586927 29685 consensus_queue.cc:1035] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:55.587157 29661 consensus_queue.cc:1035] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:55.599783 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.595943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:37379 (local address 127.20.245.130:43157)
0806 13:01:55.596019 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.596022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.596179 (+ 157us) server_negotiation.cc:407] Connection header received
0806 13:01:55.596255 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.596257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.596270 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.596317 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:55.596496 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.597374 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.598669 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.599019 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.599110 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.599437 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:55.599490 (+ 53us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:55.599560 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.599650 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.599675 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 13:01:55.599860 29707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.595751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:43157 (local address 127.20.245.129:37379)
0806 13:01:55.596087 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:55.596102 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:55.596200 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:55.596328 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:55.596329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:55.596331 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 13:01:55.596411 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.596413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.597513 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.597515 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.598577 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:55.598582 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.599157 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.599158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:55.599270 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.599310 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 13:01:55.599589 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 13:01:55.599593 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:01:55.599636 (+ 43us) client_negotiation.cc:240] Negotiation successful
0806 13:01:55.599697 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":126,"threads_started":1}
I20260806 13:01:55.615079 29130 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:55.615330 29130 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:55.616400 29130 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: Sending DeleteTablet for 3 replicas of tablet 1044de93e7e24f91b159f7a23a6cfcab
I20260806 13:01:55.616833 29556 tablet_service.cc:1514] Processing DeleteTablet for tablet 1044de93e7e24f91b159f7a23a6cfcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:55 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:51630
I20260806 13:01:55.616974 29678 tablet_replica.cc:330] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: stopping tablet replica
I20260806 13:01:55.617034 29678 raft_consensus.cc:2229] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:55.617146 29414 tablet_service.cc:1514] Processing DeleteTablet for tablet 1044de93e7e24f91b159f7a23a6cfcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:55 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34110
I20260806 13:01:55.617265 29679 tablet_replica.cc:330] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: stopping tablet replica
I20260806 13:01:55.617326 29679 raft_consensus.cc:2229] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:55.617431 29679 raft_consensus.cc:2258] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:55.617626 29678 raft_consensus.cc:2258] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:55.618166 29679 ts_tablet_manager.cc:1905] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:55.620455 29679 ts_tablet_manager.cc:1918] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:55.620540 29679 log.cc:1196] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/1044de93e7e24f91b159f7a23a6cfcab
I20260806 13:01:55.620798 29679 ts_tablet_manager.cc:1939] T 1044de93e7e24f91b159f7a23a6cfcab P 79b70d682b9a44a898c17363899ae4b3: Deleting consensus metadata
I20260806 13:01:55.621527 29271 tablet_service.cc:1514] Processing DeleteTablet for tablet 1044de93e7e24f91b159f7a23a6cfcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:55 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:40352
I20260806 13:01:55.621682 29677 tablet_replica.cc:330] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: stopping tablet replica
I20260806 13:01:55.621743 29677 raft_consensus.cc:2229] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:55.621803 29677 raft_consensus.cc:2258] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:55.622258 29677 ts_tablet_manager.cc:1905] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:55.629223 29677 ts_tablet_manager.cc:1918] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:55.629347 29677 log.cc:1196] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/1044de93e7e24f91b159f7a23a6cfcab
I20260806 13:01:55.629598 29677 ts_tablet_manager.cc:1939] T 1044de93e7e24f91b159f7a23a6cfcab P 0aa13b6399954b51b8234d234053ee2b: Deleting consensus metadata
I20260806 13:01:55.631457 29117 catalog_manager.cc:4841] TS 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263): tablet 1044de93e7e24f91b159f7a23a6cfcab (table test-table [id=b013bb79ba1a4082850f8afcb13c3dd3]) successfully deleted
I20260806 13:01:55.633186 29117 catalog_manager.cc:4841] TS 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157): tablet 1044de93e7e24f91b159f7a23a6cfcab (table test-table [id=b013bb79ba1a4082850f8afcb13c3dd3]) successfully deleted
I20260806 13:01:55.633358 29678 ts_tablet_manager.cc:1905] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:55.636003 29678 ts_tablet_manager.cc:1918] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:55.636109 29678 log.cc:1196] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/1044de93e7e24f91b159f7a23a6cfcab
I20260806 13:01:55.636358 29678 ts_tablet_manager.cc:1939] T 1044de93e7e24f91b159f7a23a6cfcab P ee502c0d7f864b34b70ac04aa5d393f4: Deleting consensus metadata
I20260806 13:01:55.637292 29115 catalog_manager.cc:4841] TS ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337): tablet 1044de93e7e24f91b159f7a23a6cfcab (table test-table [id=b013bb79ba1a4082850f8afcb13c3dd3]) successfully deleted
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 13:01:55.673287 29183 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:01:55.664707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58858 (local address 127.20.245.190:42831)
0806 13:01:55.664795 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.664798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.665065 (+ 267us) server_negotiation.cc:407] Connection header received
0806 13:01:55.665164 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.665166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.665183 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.665256 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:55.666182 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.667136 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.668533 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.668886 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.668972 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.673192 (+ 4220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58858: BlockingRecv error: recv got EOF from 127.0.0.1:58858 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 13:01:55 dist-test-slave-srgv krb5kdc[29084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM
I20260806 13:01:55.686717 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:55.674981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58860 (local address 127.20.245.190:42831)
0806 13:01:55.675040 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:55.675043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:55.675136 (+ 93us) server_negotiation.cc:407] Connection header received
0806 13:01:55.675312 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:55.675314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:55.675328 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:55.675405 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:55.676187 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.677055 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.678311 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:55.678607 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:55.678701 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:55.682544 (+ 3843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:55.682547 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:55.682548 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:55.682561 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:55.685090 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.685675 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.685677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.685677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.685761 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:55.686000 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:55.686000 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:55.686001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:55.686189 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:55.686321 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:55.686465 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 13:01:55.686574 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 13:01:55.689531 29130 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:55.689834 29130 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:55.693321 29271 tablet_service.cc:1467] Processing CreateTablet for tablet 63f1100d2c064d4da4386ef8a87ebf8a (DEFAULT_TABLE table=test-table [id=4fdf43680cf24f6c94b05e117cb04c84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.693542 29271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f1100d2c064d4da4386ef8a87ebf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.695377 29653 tablet_bootstrap.cc:492] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: Bootstrap starting.
I20260806 13:01:55.695477 29556 tablet_service.cc:1467] Processing CreateTablet for tablet 63f1100d2c064d4da4386ef8a87ebf8a (DEFAULT_TABLE table=test-table [id=4fdf43680cf24f6c94b05e117cb04c84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.695643 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f1100d2c064d4da4386ef8a87ebf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.695930 29653 tablet_bootstrap.cc:654] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.697357 29414 tablet_service.cc:1467] Processing CreateTablet for tablet 63f1100d2c064d4da4386ef8a87ebf8a (DEFAULT_TABLE table=test-table [id=4fdf43680cf24f6c94b05e117cb04c84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:55.697490 29653 tablet_bootstrap.cc:492] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: No bootstrap required, opened a new log
I20260806 13:01:55.697535 29414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63f1100d2c064d4da4386ef8a87ebf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:55.697558 29653 ts_tablet_manager.cc:1397] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:55.697752 29653 raft_consensus.cc:348] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.697852 29653 raft_consensus.cc:374] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.697876 29653 raft_consensus.cc:729] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa13b6399954b51b8234d234053ee2b, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.697937 29653 consensus_queue.cc:260] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.698052 29653 ts_tablet_manager.cc:1428] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:55.699373 29654 tablet_bootstrap.cc:492] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: Bootstrap starting.
I20260806 13:01:55.699923 29654 tablet_bootstrap.cc:654] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.700544 29658 tablet_bootstrap.cc:492] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: Bootstrap starting.
I20260806 13:01:55.701128 29658 tablet_bootstrap.cc:654] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:55.702410 29654 tablet_bootstrap.cc:492] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: No bootstrap required, opened a new log
I20260806 13:01:55.702483 29654 ts_tablet_manager.cc:1397] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 13:01:55.702742 29654 raft_consensus.cc:348] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.702858 29654 raft_consensus.cc:374] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.702884 29654 raft_consensus.cc:729] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee502c0d7f864b34b70ac04aa5d393f4, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.702937 29654 consensus_queue.cc:260] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.703039 29654 ts_tablet_manager.cc:1428] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:55.703647 29658 tablet_bootstrap.cc:492] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: No bootstrap required, opened a new log
I20260806 13:01:55.703727 29658 ts_tablet_manager.cc:1397] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260806 13:01:55.703896 29658 raft_consensus.cc:348] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.703991 29658 raft_consensus.cc:374] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:55.704010 29658 raft_consensus.cc:729] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b70d682b9a44a898c17363899ae4b3, State: Initialized, Role: FOLLOWER
I20260806 13:01:55.704062 29658 consensus_queue.cc:260] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:55.704169 29658 ts_tablet_manager.cc:1428] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:56.072530 29664 raft_consensus.cc:482] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:56.072748 29664 raft_consensus.cc:504] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.073074 29664 leader_election.cc:288] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:56.073462 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63f1100d2c064d4da4386ef8a87ebf8a" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" is_pre_election: true
I20260806 13:01:56.073490 29434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63f1100d2c064d4da4386ef8a87ebf8a" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b70d682b9a44a898c17363899ae4b3" is_pre_election: true
I20260806 13:01:56.073606 29574 raft_consensus.cc:2454] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 0.
I20260806 13:01:56.073642 29434 raft_consensus.cc:2454] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 0.
I20260806 13:01:56.073871 29224 leader_election.cc:302] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa13b6399954b51b8234d234053ee2b, 79b70d682b9a44a898c17363899ae4b3; no voters:
I20260806 13:01:56.074012 29664 raft_consensus.cc:2781] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:56.074105 29664 raft_consensus.cc:482] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:56.074153 29664 raft_consensus.cc:3037] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:56.075350 29664 raft_consensus.cc:504] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.075579 29664 leader_election.cc:288] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 election: Requested vote from peers 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:56.075935 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63f1100d2c064d4da4386ef8a87ebf8a" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4"
I20260806 13:01:56.075935 29434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63f1100d2c064d4da4386ef8a87ebf8a" candidate_uuid: "0aa13b6399954b51b8234d234053ee2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b70d682b9a44a898c17363899ae4b3"
I20260806 13:01:56.076082 29574 raft_consensus.cc:3037] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:56.076098 29434 raft_consensus.cc:3037] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:56.077232 29434 raft_consensus.cc:2454] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 1.
I20260806 13:01:56.077232 29574 raft_consensus.cc:2454] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa13b6399954b51b8234d234053ee2b in term 1.
I20260806 13:01:56.077657 29222 leader_election.cc:302] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa13b6399954b51b8234d234053ee2b, ee502c0d7f864b34b70ac04aa5d393f4; no voters:
I20260806 13:01:56.077807 29664 raft_consensus.cc:2781] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:56.077874 29664 raft_consensus.cc:686] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 1 LEADER]: Becoming Leader. State: Replica: 0aa13b6399954b51b8234d234053ee2b, State: Running, Role: LEADER
I20260806 13:01:56.077993 29664 consensus_queue.cc:237] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.078924 29130 catalog_manager.cc:5495] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa13b6399954b51b8234d234053ee2b (127.20.245.129). New cstate: current_term: 1 leader_uuid: "0aa13b6399954b51b8234d234053ee2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:56.146003 29729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:56.142697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40372 (local address 127.20.245.129:40263)
0806 13:01:56.142861 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:56.142863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:56.142871 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:01:56.142902 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:56.142903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:56.142915 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:56.143002 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:56.143275 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:56.143902 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:56.144880 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:56.145212 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:56.145298 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:56.145559 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:56.145613 (+ 54us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:56.145690 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:56.145831 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 13:01:56.145872 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260806 13:01:56.147125 29574 raft_consensus.cc:1261] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Refusing update from remote peer 0aa13b6399954b51b8234d234053ee2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:56.147178 29434 raft_consensus.cc:1261] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa13b6399954b51b8234d234053ee2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:56.147467 29660 consensus_queue.cc:1035] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:56.147629 29664 consensus_queue.cc:1035] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:56.151335 29130 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:56.151463 29130 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:56.152294 29130 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: Sending DeleteTablet for 3 replicas of tablet 63f1100d2c064d4da4386ef8a87ebf8a
I20260806 13:01:56.152603 29271 tablet_service.cc:1514] Processing DeleteTablet for tablet 63f1100d2c064d4da4386ef8a87ebf8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:56 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:40352
I20260806 13:01:56.152678 29556 tablet_service.cc:1514] Processing DeleteTablet for tablet 63f1100d2c064d4da4386ef8a87ebf8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:56 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:51630
I20260806 13:01:56.152667 29414 tablet_service.cc:1514] Processing DeleteTablet for tablet 63f1100d2c064d4da4386ef8a87ebf8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:56 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34110
I20260806 13:01:56.152901 29740 tablet_replica.cc:330] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: stopping tablet replica
I20260806 13:01:56.152973 29740 raft_consensus.cc:2229] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:56.153059 29740 raft_consensus.cc:2258] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:56.153194 29130 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:01:56.153383 29130 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:01:56.153455 29740 ts_tablet_manager.cc:1905] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:56.153733 29741 tablet_replica.cc:330] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: stopping tablet replica
I20260806 13:01:56.153800 29741 raft_consensus.cc:2229] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:56.153846 29741 raft_consensus.cc:2258] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:56.153950 29742 tablet_replica.cc:330] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: stopping tablet replica
I20260806 13:01:56.154011 29742 raft_consensus.cc:2229] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:56.154062 29742 raft_consensus.cc:2258] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:56.155122 29414 tablet_service.cc:1467] Processing CreateTablet for tablet a062daeee2e24ddb8e083e6a71e05154 (DEFAULT_TABLE table=test-table [id=891f84bd6a084de7b0607dd167a7d26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:56.155083 29556 tablet_service.cc:1467] Processing CreateTablet for tablet a062daeee2e24ddb8e083e6a71e05154 (DEFAULT_TABLE table=test-table [id=891f84bd6a084de7b0607dd167a7d26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:56.155298 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a062daeee2e24ddb8e083e6a71e05154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:56.155311 29414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a062daeee2e24ddb8e083e6a71e05154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:56.156188 29740 ts_tablet_manager.cc:1918] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:56.156252 29740 log.cc:1196] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/63f1100d2c064d4da4386ef8a87ebf8a
I20260806 13:01:56.156596 29740 ts_tablet_manager.cc:1939] T 63f1100d2c064d4da4386ef8a87ebf8a P 0aa13b6399954b51b8234d234053ee2b: Deleting consensus metadata
I20260806 13:01:56.156924 29658 tablet_bootstrap.cc:492] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: Bootstrap starting.
I20260806 13:01:56.156998 29654 tablet_bootstrap.cc:492] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: Bootstrap starting.
I20260806 13:01:56.156983 29117 catalog_manager.cc:4841] TS 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263): tablet 63f1100d2c064d4da4386ef8a87ebf8a (table test-table [id=4fdf43680cf24f6c94b05e117cb04c84]) successfully deleted
I20260806 13:01:56.157378 29654 tablet_bootstrap.cc:654] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:56.157385 29658 tablet_bootstrap.cc:654] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:56.157485 29741 ts_tablet_manager.cc:1905] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:56.157893 29271 tablet_service.cc:1467] Processing CreateTablet for tablet a062daeee2e24ddb8e083e6a71e05154 (DEFAULT_TABLE table=test-table [id=891f84bd6a084de7b0607dd167a7d26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:01:56.158010 29271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a062daeee2e24ddb8e083e6a71e05154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:56.158018 29654 tablet_bootstrap.cc:492] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: No bootstrap required, opened a new log
I20260806 13:01:56.158066 29654 ts_tablet_manager.cc:1397] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:56.158233 29654 raft_consensus.cc:348] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.158315 29654 raft_consensus.cc:374] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:56.158339 29654 raft_consensus.cc:729] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee502c0d7f864b34b70ac04aa5d393f4, State: Initialized, Role: FOLLOWER
I20260806 13:01:56.158388 29654 consensus_queue.cc:260] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.158494 29654 ts_tablet_manager.cc:1428] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 13:01:56.158557 29742 ts_tablet_manager.cc:1905] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:56.159163 29741 ts_tablet_manager.cc:1918] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:56.159257 29741 log.cc:1196] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/63f1100d2c064d4da4386ef8a87ebf8a
I20260806 13:01:56.159510 29741 ts_tablet_manager.cc:1939] T 63f1100d2c064d4da4386ef8a87ebf8a P ee502c0d7f864b34b70ac04aa5d393f4: Deleting consensus metadata
I20260806 13:01:56.159595 29653 tablet_bootstrap.cc:492] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b: Bootstrap starting.
I20260806 13:01:56.160012 29115 catalog_manager.cc:4841] TS ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337): tablet 63f1100d2c064d4da4386ef8a87ebf8a (table test-table [id=4fdf43680cf24f6c94b05e117cb04c84]) successfully deleted
I20260806 13:01:56.160043 29653 tablet_bootstrap.cc:654] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:56.160535 29658 tablet_bootstrap.cc:492] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: No bootstrap required, opened a new log
I20260806 13:01:56.160590 29658 ts_tablet_manager.cc:1397] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260806 13:01:56.160740 29658 raft_consensus.cc:348] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.160782 29742 ts_tablet_manager.cc:1918] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:01:56.160849 29742 log.cc:1196] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/63f1100d2c064d4da4386ef8a87ebf8a
I20260806 13:01:56.160804 29658 raft_consensus.cc:374] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:56.160879 29658 raft_consensus.cc:729] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b70d682b9a44a898c17363899ae4b3, State: Initialized, Role: FOLLOWER
I20260806 13:01:56.161036 29742 ts_tablet_manager.cc:1939] T 63f1100d2c064d4da4386ef8a87ebf8a P 79b70d682b9a44a898c17363899ae4b3: Deleting consensus metadata
I20260806 13:01:56.160997 29658 consensus_queue.cc:260] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.161048 29653 tablet_bootstrap.cc:492] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b: No bootstrap required, opened a new log
I20260806 13:01:56.161098 29653 ts_tablet_manager.cc:1397] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:56.161136 29658 ts_tablet_manager.cc:1428] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 13:01:56.161239 29653 raft_consensus.cc:348] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.161311 29653 raft_consensus.cc:374] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:56.161325 29653 raft_consensus.cc:729] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa13b6399954b51b8234d234053ee2b, State: Initialized, Role: FOLLOWER
I20260806 13:01:56.161363 29653 consensus_queue.cc:260] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.161439 29653 ts_tablet_manager.cc:1428] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:56.161926 29117 catalog_manager.cc:4841] TS 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157): tablet 63f1100d2c064d4da4386ef8a87ebf8a (table test-table [id=4fdf43680cf24f6c94b05e117cb04c84]) successfully deleted
I20260806 13:01:56.204885 29708 raft_consensus.cc:482] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:01:56.205039 29708 raft_consensus.cc:504] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.205338 29708 leader_election.cc:288] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:56.205662 29291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a062daeee2e24ddb8e083e6a71e05154" candidate_uuid: "79b70d682b9a44a898c17363899ae4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa13b6399954b51b8234d234053ee2b" is_pre_election: true
I20260806 13:01:56.205710 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a062daeee2e24ddb8e083e6a71e05154" candidate_uuid: "79b70d682b9a44a898c17363899ae4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" is_pre_election: true
I20260806 13:01:56.205852 29291 raft_consensus.cc:2454] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b70d682b9a44a898c17363899ae4b3 in term 0.
I20260806 13:01:56.205909 29574 raft_consensus.cc:2454] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b70d682b9a44a898c17363899ae4b3 in term 0.
I20260806 13:01:56.206087 29367 leader_election.cc:302] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa13b6399954b51b8234d234053ee2b, 79b70d682b9a44a898c17363899ae4b3; no voters:
I20260806 13:01:56.206215 29708 raft_consensus.cc:2781] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:01:56.206264 29708 raft_consensus.cc:482] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:01:56.206291 29708 raft_consensus.cc:3037] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:56.207334 29708 raft_consensus.cc:504] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.207540 29708 leader_election.cc:288] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263), ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337)
I20260806 13:01:56.207816 29574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a062daeee2e24ddb8e083e6a71e05154" candidate_uuid: "79b70d682b9a44a898c17363899ae4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee502c0d7f864b34b70ac04aa5d393f4"
I20260806 13:01:56.207842 29291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a062daeee2e24ddb8e083e6a71e05154" candidate_uuid: "79b70d682b9a44a898c17363899ae4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa13b6399954b51b8234d234053ee2b"
I20260806 13:01:56.207945 29574 raft_consensus.cc:3037] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:56.207980 29291 raft_consensus.cc:3037] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:56.208770 29574 raft_consensus.cc:2454] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b70d682b9a44a898c17363899ae4b3 in term 1.
I20260806 13:01:56.208930 29291 raft_consensus.cc:2454] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b70d682b9a44a898c17363899ae4b3 in term 1.
I20260806 13:01:56.209115 29365 leader_election.cc:302] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b70d682b9a44a898c17363899ae4b3, ee502c0d7f864b34b70ac04aa5d393f4; no voters:
I20260806 13:01:56.209448 29708 raft_consensus.cc:2781] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:56.209637 29708 raft_consensus.cc:686] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 79b70d682b9a44a898c17363899ae4b3, State: Running, Role: LEADER
I20260806 13:01:56.209738 29708 consensus_queue.cc:237] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } }
I20260806 13:01:56.210753 29130 catalog_manager.cc:5495] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130). New cstate: current_term: 1 leader_uuid: "79b70d682b9a44a898c17363899ae4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b70d682b9a44a898c17363899ae4b3" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 43157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 } health_report { overall_health: UNKNOWN } } }
I20260806 13:01:56.228915 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:56.225035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34124 (local address 127.20.245.130:43157)
0806 13:01:56.225402 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:56.225404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:56.225414 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:01:56.225450 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:56.225450 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:56.225465 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:56.225578 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:01:56.225856 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:56.226683 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:56.228023 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:56.228264 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:56.228350 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:56.228524 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:01:56.228572 (+ 48us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:01:56.228639 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:56.228703 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 13:01:56.228737 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":238,"threads_started":1}
I20260806 13:01:56.233084 29291 raft_consensus.cc:1261] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Refusing update from remote peer 79b70d682b9a44a898c17363899ae4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:56.233084 29574 raft_consensus.cc:1261] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Refusing update from remote peer 79b70d682b9a44a898c17363899ae4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:01:56.233624 29708 consensus_queue.cc:1035] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee502c0d7f864b34b70ac04aa5d393f4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 42337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:56.233824 29746 consensus_queue.cc:1035] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa13b6399954b51b8234d234053ee2b" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 40263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:01:56.250994 29132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:56.251163 29132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:01:56.252255 29132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec178a5e42944712a82812b32cdcc3cc: Sending DeleteTablet for 3 replicas of tablet a062daeee2e24ddb8e083e6a71e05154
I20260806 13:01:56.252626 29271 tablet_service.cc:1514] Processing DeleteTablet for tablet a062daeee2e24ddb8e083e6a71e05154 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:56 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:40352
I20260806 13:01:56.252635 29414 tablet_service.cc:1514] Processing DeleteTablet for tablet a062daeee2e24ddb8e083e6a71e05154 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:56 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34110
I20260806 13:01:56.252663 29556 tablet_service.cc:1514] Processing DeleteTablet for tablet a062daeee2e24ddb8e083e6a71e05154 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:01:56 UTC) from {username='oryx', principal='oryx/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:51630
I20260806 13:01:56.252784 29741 tablet_replica.cc:330] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: stopping tablet replica
I20260806 13:01:56.252833 29740 tablet_replica.cc:330] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b: stopping tablet replica
I20260806 13:01:56.252866 29741 raft_consensus.cc:2229] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:56.252905 29740 raft_consensus.cc:2229] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:01:56.252907 29742 tablet_replica.cc:330] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: stopping tablet replica
I20260806 13:01:56.252929 29741 raft_consensus.cc:2258] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:56.252972 29740 raft_consensus.cc:2258] T a062daeee2e24ddb8e083e6a71e05154 P 0aa13b6399954b51b8234d234053ee2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:56.252985 29742 raft_consensus.cc:2229] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:01:56.253082 29742 raft_consensus.cc:2258] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:01:56.253469 29741 ts_tablet_manager.cc:1905] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:56.253592 29742 ts_tablet_manager.cc:1905] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:01:56.253829 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 29205
I20260806 13:01:56.255542 29742 ts_tablet_manager.cc:1918] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:56.255542 29741 ts_tablet_manager.cc:1918] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 13:01:56.255620 29742 log.cc:1196] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/a062daeee2e24ddb8e083e6a71e05154
I20260806 13:01:56.255620 29741 log.cc:1196] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/a062daeee2e24ddb8e083e6a71e05154
I20260806 13:01:56.255892 29742 ts_tablet_manager.cc:1939] T a062daeee2e24ddb8e083e6a71e05154 P 79b70d682b9a44a898c17363899ae4b3: Deleting consensus metadata
I20260806 13:01:56.255892 29741 ts_tablet_manager.cc:1939] T a062daeee2e24ddb8e083e6a71e05154 P ee502c0d7f864b34b70ac04aa5d393f4: Deleting consensus metadata
I20260806 13:01:56.256837 29117 catalog_manager.cc:4841] TS 79b70d682b9a44a898c17363899ae4b3 (127.20.245.130:43157): tablet a062daeee2e24ddb8e083e6a71e05154 (table test-table [id=891f84bd6a084de7b0607dd167a7d26b]) successfully deleted
I20260806 13:01:56.256995 29115 catalog_manager.cc:4841] TS ee502c0d7f864b34b70ac04aa5d393f4 (127.20.245.131:42337): tablet a062daeee2e24ddb8e083e6a71e05154 (table test-table [id=891f84bd6a084de7b0607dd167a7d26b]) successfully deleted
W20260806 13:01:56.263396 29117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:40263 (error 108)
I20260806 13:01:56.263696 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 29347
I20260806 13:01:56.265065 29755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:56.264040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:40263 (local address 127.0.0.1:40384)
0806 13:01:56.264916 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:56.264989 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:40263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":844,"thread_start_us":49,"threads_started":1}
W20260806 13:01:56.266065 29117 catalog_manager.cc:4584] TS 0aa13b6399954b51b8234d234053ee2b (127.20.245.129:40263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a062daeee2e24ddb8e083e6a71e05154: Network error: Client connection negotiation failed: client connection to 127.20.245.129:40263: connect: Connection refused (error 111)
I20260806 13:01:56.271274 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 29490
I20260806 13:01:56.278733 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 29099
2026-08-06T13:01:56Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3224 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:56 dist-test-slave-srgv krb5kdc[29758](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:56 dist-test-slave-srgv krb5kdc[29758](info): set up 2 sockets
Aug 06 13:01:56 dist-test-slave-srgv krb5kdc[29758](info): commencing operation
krb5kdc: starting...
W20260806 13:01:57.389844 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:57 dist-test-slave-srgv krb5kdc[29758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:57.552265 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:45881
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:45881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:57.655973 29772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:57.656324 29772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:57.656361 29772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:57.658097 29772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:57.658186 29772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:57.658205 29772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:57.658221 29772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:57.658237 29772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:57.660642 29772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:45881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:45881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:57.661114 29772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:57.661476 29772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:57.669571 29780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:57.669682 29772 server_base.cc:1034] running on GCE node
W20260806 13:01:57.669685 29778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:57.669684 29777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:57.670269 29772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:57.670732 29772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:57.671958 29772 hybrid_clock.cc:648] HybridClock initialized: now 1786021317671917 us; error 63 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T13:01:57Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1399 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:01:57 dist-test-slave-srgv krb5kdc[29785](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:01:57 dist-test-slave-srgv krb5kdc[29785](info): set up 2 sockets
Aug 06 13:01:57 dist-test-slave-srgv krb5kdc[29785](info): commencing operation
krb5kdc: starting...
W20260806 13:01:58.813736 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:01:58 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:01:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:01:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:01:58.971818 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36315
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:36315
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:59.076167 29798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:59.076488 29798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:59.076519 29798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:59.078111 29798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:01:59.078210 29798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:59.078227 29798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:59.078241 29798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:01:59.078254 29798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:01:59.080421 29798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:36315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:59.080833 29798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:59.081151 29798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:59.087442 29804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:59.087474 29806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:59.087514 29798 server_base.cc:1034] running on GCE node
W20260806 13:01:59.087476 29803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:59.088038 29798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:59.088411 29798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:59.089594 29798 hybrid_clock.cc:648] HybridClock initialized: now 1786021319089582 us; error 50 us; skew 500 ppm
Aug 06 13:01:59 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021319, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:59.093374 29798 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:01:59.094118 29798 webserver.cc:460] Webserver started at http://127.20.245.190:39117/ using document root <none> and password file <none>
I20260806 13:01:59.094453 29798 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:59.094537 29798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:59.094715 29798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:59.096230 29798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "18df8ff6cdf5971c7f0e62fa7b70e152"
server_key_iv: "f0e80bab25bd3de6acbdbb10ca00c462"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.096748 29798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "18df8ff6cdf5971c7f0e62fa7b70e152"
server_key_iv: "f0e80bab25bd3de6acbdbb10ca00c462"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.098623 29798 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:59.099908 29813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.100193 29798 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:59.100334 29798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "18df8ff6cdf5971c7f0e62fa7b70e152"
server_key_iv: "f0e80bab25bd3de6acbdbb10ca00c462"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.100437 29798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:59.112463 29798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:59.115660 29798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:59.115902 29798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:59.121250 29798 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:36315
I20260806 13:01:59.121291 29865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:36315 every 8 connection(s)
I20260806 13:01:59.121789 29798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:01:59.122989 29866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:01:59.126011 29866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Bootstrap starting.
I20260806 13:01:59.126753 29866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Neither blocks nor log segments found. Creating new log.
I20260806 13:01:59.127058 29866 log.cc:824] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:01:59.128144 29866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: No bootstrap required, opened a new log
I20260806 13:01:59.130316 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 29798
I20260806 13:01:59.130228 29866 raft_consensus.cc:348] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } }
I20260806 13:01:59.130452 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:01:59.130465 29866 raft_consensus.cc:374] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:01:59.130517 29866 raft_consensus.cc:729] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bba7403cbbc14ae1ae8ff377b96b3c6a, State: Initialized, Role: FOLLOWER
I20260806 13:01:59.130693 21462 external_mini_cluster.cc:1428] Setting key 32f5a5dce7dfbd36552448d0515acb78
I20260806 13:01:59.130725 29866 consensus_queue.cc:260] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } }
I20260806 13:01:59.130839 29866 raft_consensus.cc:388] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:01:59.130877 29866 raft_consensus.cc:482] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:01:59.130934 29866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:01:59.131891 29866 raft_consensus.cc:504] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } }
I20260806 13:01:59.132028 29866 leader_election.cc:302] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bba7403cbbc14ae1ae8ff377b96b3c6a; no voters:
I20260806 13:01:59.132302 29866 leader_election.cc:288] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:01:59.132364 29871 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:01:59.132521 29871 raft_consensus.cc:686] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 1 LEADER]: Becoming Leader. State: Replica: bba7403cbbc14ae1ae8ff377b96b3c6a, State: Running, Role: LEADER
I20260806 13:01:59.132651 29866 sys_catalog.cc:564] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:01:59.132673 29871 consensus_queue.cc:237] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } }
I20260806 13:01:59.133167 29872 sys_catalog.cc:455] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } } }
I20260806 13:01:59.133266 29872 sys_catalog.cc:458] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:59.133484 29873 sys_catalog.cc:455] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bba7403cbbc14ae1ae8ff377b96b3c6a. Latest consensus state: current_term: 1 leader_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } } }
I20260806 13:01:59.133620 29873 sys_catalog.cc:458] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: This master's current role is: LEADER
I20260806 13:01:59.133808 29879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:01:59.134467 29879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:01:59.136494 29879 catalog_manager.cc:1347] Generated new cluster ID: 6fd77ee3695649cd9b61cdbe09073a91
I20260806 13:01:59.136557 29879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:01:59 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:59.146188 29870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:59.131426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33790 (local address 127.20.245.190:36315)
0806 13:01:59.132262 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:59.132274 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:59.132349 (+ 75us) server_negotiation.cc:407] Connection header received
0806 13:01:59.132534 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:59.132545 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:59.132625 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:59.133926 (+ 1301us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:59.134092 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.135667 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.136977 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.137714 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.137838 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:59.141354 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:59.141360 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:59.141361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:59.141380 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:59.144041 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:59.144570 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:59.144575 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:59.144576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:59.144748 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:59.144971 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:59.144972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:59.144973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:59.145399 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:59.145614 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:59.145707 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 13:01:59.145894 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":771,"thread_start_us":615,"threads_started":1}
I20260806 13:01:59.153911 29879 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:01:59.154940 29879 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:01:59.160957 29879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Generated new TSK 0
I20260806 13:01:59.161258 29879 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:01:59.200857 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36315
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:59.314213 29893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:59.314596 29893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:59.314651 29893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:59.316370 29893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:59.316464 29893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:59.316504 29893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:01:59.318675 29893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:59.319092 29893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:59.319442 29893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:59.326380 29901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:59.326380 29898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:59.326380 29899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:59.326768 29893 server_base.cc:1034] running on GCE node
I20260806 13:01:59.327062 29893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:59.327493 29893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:59.328713 29893 hybrid_clock.cc:648] HybridClock initialized: now 1786021319328684 us; error 69 us; skew 500 ppm
Aug 06 13:01:59 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021319, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:59.333688 29893 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:01:59.334378 29893 webserver.cc:460] Webserver started at http://127.20.245.129:42583/ using document root <none> and password file <none>
I20260806 13:01:59.334683 29893 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:59.334759 29893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:59.334928 29893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:59.336453 29893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "e3582e6d32eb4954ba35f78c1a4615f2"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "edb95b1b2bc88404760da43fbc3bba03"
server_key_iv: "b289a6c374a70b606732b9c35767a710"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.337000 29893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "e3582e6d32eb4954ba35f78c1a4615f2"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "edb95b1b2bc88404760da43fbc3bba03"
server_key_iv: "b289a6c374a70b606732b9c35767a710"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.339986 29893 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260806 13:01:59.341850 29908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.342353 29893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:01:59.342696 29893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "e3582e6d32eb4954ba35f78c1a4615f2"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "edb95b1b2bc88404760da43fbc3bba03"
server_key_iv: "b289a6c374a70b606732b9c35767a710"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.342880 29893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:59.361270 29893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:59.364674 29893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:59.364907 29893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:59.365242 29893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:59.365656 29893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:59.365713 29893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.365759 29893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:59.365790 29893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.374347 29893 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:33417
I20260806 13:01:59.374387 30024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:33417 every 8 connection(s)
I20260806 13:01:59.374825 29893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:01:59.382768 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 29893
I20260806 13:01:59.382897 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:01:59.383262 21462 external_mini_cluster.cc:1428] Setting key c793713101e2ae2e5c278e1596119029
Aug 06 13:01:59 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021319, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:59.388831 29870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:59.376112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:34547 (local address 127.20.245.190:36315)
0806 13:01:59.376231 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:59.376234 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:59.376675 (+ 441us) server_negotiation.cc:407] Connection header received
0806 13:01:59.377527 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:59.377529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:59.377552 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:59.377609 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:59.378820 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.379501 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.381101 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.381360 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.381454 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:59.384546 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:59.384548 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:59.384548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:59.384560 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:59.386686 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:59.387376 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:59.387377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:59.387378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:59.387449 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:59.387834 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:59.387836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:59.387836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:59.388032 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:59.388127 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:59.388519 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 13:01:59.388653 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 13:01:59.388877 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:59.376080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:34547)
0806 13:01:59.376434 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:59.376507 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:59.377386 (+ 879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:59.377711 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:59.377716 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:59.378430 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:59.378698 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:59.378703 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.379621 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.379622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:59.380895 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:59.380898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.381470 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.381472 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:59.381637 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:59.382302 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:59.382313 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:59.384431 (+ 2118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:59.386795 (+ 2364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:59.386808 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:59.386811 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:59.387267 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:59.387535 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:59.387536 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:59.387537 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:59.387721 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:59.388146 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:59.388154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:59.388351 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 13:01:59.388467 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 13:01:59.388653 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":181,"threads_started":1}
I20260806 13:01:59.389698 30025 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36315
I20260806 13:01:59.389851 30025 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:59.390101 30025 heartbeater.cc:511] Master 127.20.245.190:36315 requested a full tablet report, sending...
I20260806 13:01:59.390921 29830 ts_manager.cc:194] Registered new tserver with Master: e3582e6d32eb4954ba35f78c1a4615f2 (127.20.245.129:33417)
I20260806 13:01:59.391780 29830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:34547
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:01:59.420385 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36315
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:59.564527 30030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:59.564910 30030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:59.564952 30030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:59.567008 30030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:59.567334 30030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:59.567407 30030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:01:59.569751 30030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:59.570195 30030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:59.570549 30030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:59.578269 30035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:59.578344 30038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:59.578263 30036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:59.579164 30030 server_base.cc:1034] running on GCE node
I20260806 13:01:59.579608 30030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:59.580159 30030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:59.581491 30030 hybrid_clock.cc:648] HybridClock initialized: now 1786021319581451 us; error 85 us; skew 500 ppm
Aug 06 13:01:59 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021319, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:59.592340 30030 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:01:59.593449 30030 webserver.cc:460] Webserver started at http://127.20.245.130:39299/ using document root <none> and password file <none>
I20260806 13:01:59.593869 30030 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:59.593969 30030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:59.594218 30030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:59.596318 30030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "295fb4f34384436489a7b9e011a7e80c"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "24821560801f592a90f31f2805d50d63"
server_key_iv: "c4b57300d10f4d3b8e648915d4657e58"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.597023 30030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "295fb4f34384436489a7b9e011a7e80c"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "24821560801f592a90f31f2805d50d63"
server_key_iv: "c4b57300d10f4d3b8e648915d4657e58"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.599789 30030 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:01:59.601222 30045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.601537 30030 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:59.601688 30030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "295fb4f34384436489a7b9e011a7e80c"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "24821560801f592a90f31f2805d50d63"
server_key_iv: "c4b57300d10f4d3b8e648915d4657e58"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.601817 30030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:59.615949 30030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:59.621371 30030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:59.621753 30030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:59.622304 30030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:59.622969 30030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:59.623067 30030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.623165 30030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:59.623263 30030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.635854 30030 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:35983
I20260806 13:01:59.635943 30160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:35983 every 8 connection(s)
I20260806 13:01:59.636476 30030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:01:59.640282 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 30030
I20260806 13:01:59.640413 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:01:59.640801 21462 external_mini_cluster.cc:1428] Setting key 0ea83f4aaa357300bad935022fff2749
Aug 06 13:01:59 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021319, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:59.653949 29870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:59.637885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:58649 (local address 127.20.245.190:36315)
0806 13:01:59.638033 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:59.638036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:59.638244 (+ 208us) server_negotiation.cc:407] Connection header received
0806 13:01:59.638945 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:59.638947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:59.638965 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:59.639045 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:59.640540 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.641475 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.643936 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.644197 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.644295 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:59.648345 (+ 4050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:59.648352 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:59.648353 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:59.648372 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:59.651242 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:59.652266 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:59.652268 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:59.652269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:59.652353 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:59.652829 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:59.652831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:59.652831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:59.653005 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:59.653075 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:59.653724 (+ 649us) server_negotiation.cc:299] Negotiation successful
0806 13:01:59.653854 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 13:01:59.654636 30163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:59.637820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:58649)
0806 13:01:59.638037 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:59.638096 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:59.638777 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:59.639130 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:59.639135 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:59.640014 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:59.640384 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:59.640396 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.641672 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.641674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:59.643744 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:59.643751 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.644357 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.644358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:59.644585 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:59.645617 (+ 1032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:59.645634 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:59.647938 (+ 2304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:59.651436 (+ 3498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:59.651462 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:59.651467 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:59.652095 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:59.652450 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:59.652451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:59.652452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:59.652703 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:59.653104 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:59.653115 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:59.653447 (+ 332us) client_negotiation.cc:769] Sending connection context
0806 13:01:59.653619 (+ 172us) client_negotiation.cc:240] Negotiation successful
0806 13:01:59.653922 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":122,"threads_started":1}
I20260806 13:01:59.655503 30161 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36315
I20260806 13:01:59.655665 30161 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:59.655992 30161 heartbeater.cc:511] Master 127.20.245.190:36315 requested a full tablet report, sending...
I20260806 13:01:59.656663 29830 ts_manager.cc:194] Registered new tserver with Master: 295fb4f34384436489a7b9e011a7e80c (127.20.245.130:35983)
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
I20260806 13:01:59.657189 29830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:58649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:01:59.684986 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36315
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:01:59.807752 30166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:01:59.808320 30166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:01:59.808430 30166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:01:59.810978 30166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:01:59.811242 30166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:01:59.811364 30166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:01:59.814548 30166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:01:59.815339 30166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:01:59.815707 30166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:01:59.825776 30174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:59.825757 30171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:01:59.825876 30172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:01:59.825920 30166 server_base.cc:1034] running on GCE node
I20260806 13:01:59.826349 30166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:01:59.826732 30166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:01:59.827907 30166 hybrid_clock.cc:648] HybridClock initialized: now 1786021319827882 us; error 42 us; skew 500 ppm
Aug 06 13:01:59 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021319, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:01:59.831097 30166 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:01:59.831847 30166 webserver.cc:460] Webserver started at http://127.20.245.131:36521/ using document root <none> and password file <none>
I20260806 13:01:59.832160 30166 fs_manager.cc:359] Metadata directory not provided
I20260806 13:01:59.832214 30166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:01:59.832382 30166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:01:59.834439 30166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "ebeb3fd4b78f40f5a48c1dddea92a9f5"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "58d89c049509146a5c4fb09b205d34ee"
server_key_iv: "3629b28916c73f88fab2a45dbbcf984d"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.835021 30166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "ebeb3fd4b78f40f5a48c1dddea92a9f5"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "58d89c049509146a5c4fb09b205d34ee"
server_key_iv: "3629b28916c73f88fab2a45dbbcf984d"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.836987 30166 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 13:01:59.838442 30181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.838716 30166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:01:59.838899 30166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "ebeb3fd4b78f40f5a48c1dddea92a9f5"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "58d89c049509146a5c4fb09b205d34ee"
server_key_iv: "3629b28916c73f88fab2a45dbbcf984d"
server_key_version: "encryptionkey@0"
I20260806 13:01:59.839049 30166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:01:59.851418 30166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:01:59.854974 30166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:01:59.855204 30166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:01:59.855568 30166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:01:59.855999 30166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:01:59.856036 30166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.856063 30166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:01:59.856076 30166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:01:59.867956 30166 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:44611
I20260806 13:01:59.868090 30297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:44611 every 8 connection(s)
I20260806 13:01:59.868767 30166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:01:59.874768 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 30166
I20260806 13:01:59.874902 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:01:59.875221 21462 external_mini_cluster.cc:1428] Setting key 72f2b62ebf233e4076659ab10a771ec4
Aug 06 13:01:59 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021319, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:01:59.882788 29870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:59.870185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:55575 (local address 127.20.245.190:36315)
0806 13:01:59.870325 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 13:01:59.870328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:01:59.870489 (+ 161us) server_negotiation.cc:407] Connection header received
0806 13:01:59.871326 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:01:59.871328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:01:59.871342 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:01:59.871416 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:01:59.872783 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.873493 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.875157 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.875497 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.875598 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:59.878765 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:01:59.878767 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:01:59.878767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:01:59.878788 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:01:59.880463 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:59.881146 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:59.881148 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:59.881148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:59.881227 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:01:59.881619 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:01:59.881620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:01:59.881628 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:01:59.881871 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:01:59.881963 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 13:01:59.882537 (+ 574us) server_negotiation.cc:299] Negotiation successful
0806 13:01:59.882654 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 13:01:59.883074 30300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:01:59.870095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:55575)
0806 13:01:59.870322 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 13:01:59.870380 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 13:01:59.871052 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:01:59.871537 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:01:59.871542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:01:59.872376 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:01:59.872661 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:59.872667 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.873675 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.873676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:59.875060 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:01:59.875063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:01:59.875610 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:01:59.875612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:01:59.875836 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:01:59.876572 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:01:59.876583 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:01:59.878530 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:01:59.880587 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:59.880603 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:59.880607 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:59.880965 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:59.881315 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:01:59.881316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:01:59.881316 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:01:59.881496 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:01:59.881961 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:01:59.881971 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:01:59.882253 (+ 282us) client_negotiation.cc:769] Sending connection context
0806 13:01:59.882491 (+ 238us) client_negotiation.cc:240] Negotiation successful
0806 13:01:59.882744 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":131,"threads_started":1}
I20260806 13:01:59.883837 30298 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36315
I20260806 13:01:59.883956 30298 heartbeater.cc:464] Registering TS with master...
I20260806 13:01:59.884210 30298 heartbeater.cc:511] Master 127.20.245.190:36315 requested a full tablet report, sending...
I20260806 13:01:59.884752 29830 ts_manager.cc:194] Registered new tserver with Master: ebeb3fd4b78f40f5a48c1dddea92a9f5 (127.20.245.131:44611)
I20260806 13:01:59.885224 29830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:55575
I20260806 13:01:59.888130 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab.
Entry for principal oryx/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab.
WARNING: no policy specified for oryx/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab.
Entry for principal oryx/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab.
WARNING: no policy specified for oryx/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab.
Entry for principal oryx/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab.
I20260806 13:02:00.016920 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 29893
I20260806 13:02:00.025038 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 30030
I20260806 13:02:00.031967 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 30166
I20260806 13:02:00.040829 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 29798
I20260806 13:02:00.049266 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36315
--webserver_interface=127.20.245.190
--webserver_port=39117
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:36315
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:02:00.169703 30307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:00.170030 30307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:00.170063 30307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:00.171823 30307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:02:00.171908 30307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:00.171927 30307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:00.171941 30307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:02:00.171954 30307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:02:00.174585 30307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:36315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=39117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:00.175097 30307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:00.175535 30307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:00.182024 30313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:00.182019 30312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:00.182019 30315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:00.182471 30307 server_base.cc:1034] running on GCE node
I20260806 13:02:00.182780 30307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:00.183159 30307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:00.184408 30307 hybrid_clock.cc:648] HybridClock initialized: now 1786021320184386 us; error 41 us; skew 500 ppm
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021320, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:02:00.189540 30307 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:02:00.190413 30307 webserver.cc:460] Webserver started at http://127.20.245.190:39117/ using document root <none> and password file <none>
I20260806 13:02:00.190762 30307 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:00.190879 30307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:00.193858 30307 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:02:00.195001 30322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.195406 30307 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:00.195554 30307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "18df8ff6cdf5971c7f0e62fa7b70e152"
server_key_iv: "f0e80bab25bd3de6acbdbb10ca00c462"
server_key_version: "encryptionkey@0"
I20260806 13:02:00.196156 30307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:00.208814 30307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:00.212704 30307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:00.212961 30307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:00.219293 30307 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:36315
I20260806 13:02:00.219478 30377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:36315 every 8 connection(s)
I20260806 13:02:00.220011 30307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:02:00.222461 30378 sys_catalog.cc:263] Verifying existing consensus state
I20260806 13:02:00.223774 30378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Bootstrap starting.
I20260806 13:02:00.229086 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 30307
I20260806 13:02:00.229599 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:33417
--local_ip_for_outbound_sockets=127.20.245.129
--tserver_master_addrs=127.20.245.190:36315
--webserver_port=42583
--webserver_interface=127.20.245.129
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.245.129
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:02:00.237965 30378 log.cc:824] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:02:00.241755 30378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:02:00.242496 30378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Bootstrap complete.
I20260806 13:02:00.246248 30378 raft_consensus.cc:348] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } }
I20260806 13:02:00.246771 30378 raft_consensus.cc:729] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bba7403cbbc14ae1ae8ff377b96b3c6a, State: Initialized, Role: FOLLOWER
I20260806 13:02:00.247012 30378 consensus_queue.cc:260] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } }
I20260806 13:02:00.247108 30378 raft_consensus.cc:388] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:02:00.247225 30378 raft_consensus.cc:482] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:02:00.247285 30378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 1 FOLLOWER]: Advancing to term 2
I20260806 13:02:00.248835 30378 raft_consensus.cc:504] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } }
I20260806 13:02:00.248970 30378 leader_election.cc:302] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bba7403cbbc14ae1ae8ff377b96b3c6a; no voters:
I20260806 13:02:00.249293 30378 leader_election.cc:288] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 13:02:00.249351 30383 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 2 FOLLOWER]: Leader election won for term 2
I20260806 13:02:00.249513 30383 raft_consensus.cc:686] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [term 2 LEADER]: Becoming Leader. State: Replica: bba7403cbbc14ae1ae8ff377b96b3c6a, State: Running, Role: LEADER
I20260806 13:02:00.249662 30383 consensus_queue.cc:237] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } }
I20260806 13:02:00.249706 30378 sys_catalog.cc:564] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:02:00.250073 30385 sys_catalog.cc:455] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bba7403cbbc14ae1ae8ff377b96b3c6a. Latest consensus state: current_term: 2 leader_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } } }
I20260806 13:02:00.250334 30385 sys_catalog.cc:458] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: This master's current role is: LEADER
I20260806 13:02:00.250269 30384 sys_catalog.cc:455] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bba7403cbbc14ae1ae8ff377b96b3c6a" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36315 } } }
I20260806 13:02:00.250662 30384 sys_catalog.cc:458] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a [sys.catalog]: This master's current role is: LEADER
I20260806 13:02:00.250828 30389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:02:00.252168 30389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:02:00.252406 30389 catalog_manager.cc:1259] Loaded cluster ID: 6fd77ee3695649cd9b61cdbe09073a91
I20260806 13:02:00.252712 30389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:02:00.254040 30389 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:02:00.254436 30389 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bba7403cbbc14ae1ae8ff377b96b3c6a: Loaded TSK: 0
I20260806 13:02:00.254751 30389 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 13:02:00.355312 30381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:00.355612 30381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:00.355724 30381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:00.357734 30381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:00.357831 30381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:00.357872 30381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:02:00.359992 30381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.129.keytab
--principal=oryx/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:33417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=42583
--tserver_master_addrs=127.20.245.190:36315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:00.360368 30381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:00.360728 30381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:02:00.367339 30381 server_base.cc:1034] running on GCE node
W20260806 13:02:00.367298 30405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:00.367449 30408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:00.367305 30406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:00.368000 30381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:00.368371 30381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:00.369566 30381 hybrid_clock.cc:648] HybridClock initialized: now 1786021320369541 us; error 44 us; skew 500 ppm
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021320, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:02:00.373178 30381 init.cc:377] Logged in from keytab as oryx/127.20.245.129@KRBTEST.COM (short username oryx)
I20260806 13:02:00.373863 30381 webserver.cc:460] Webserver started at http://127.20.245.129:42583/ using document root <none> and password file <none>
I20260806 13:02:00.374171 30381 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:00.374243 30381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:00.376258 30381 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:02:00.377121 30416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.377417 30381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:00.377619 30381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "e3582e6d32eb4954ba35f78c1a4615f2"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "edb95b1b2bc88404760da43fbc3bba03"
server_key_iv: "b289a6c374a70b606732b9c35767a710"
server_key_version: "encryptionkey@0"
I20260806 13:02:00.378114 30381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:00.395886 30381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:00.398964 30381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:00.399230 30381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:00.399605 30381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:00.400065 30381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:00.400132 30381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.400177 30381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:00.400205 30381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.409868 30381 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:33417
I20260806 13:02:00.410945 30381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:02:00.411665 30530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:33417 every 8 connection(s)
I20260806 13:02:00.413093 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 30381
I20260806 13:02:00.413475 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:35983
--local_ip_for_outbound_sockets=127.20.245.130
--tserver_master_addrs=127.20.245.190:36315
--webserver_port=39299
--webserver_interface=127.20.245.130
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.245.130
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.434517 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.416393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:55155)
0806 13:02:00.419040 (+ 2647us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.419124 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.419965 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.422021 (+ 2056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.422035 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.423734 (+ 1699us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.424406 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.424427 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.426534 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.426536 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.428250 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.428256 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.429165 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.429167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.429340 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.430357 (+ 1017us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.430380 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.434221 (+ 3841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2564,"thread_start_us":170,"threads_started":1}
W20260806 13:02:00.434672 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.416960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:55155 (local address 127.20.245.190:36315)
0806 13:02:00.417277 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.417291 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.420944 (+ 3653us) server_negotiation.cc:407] Connection header received
0806 13:02:00.421166 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.421175 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.421270 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.421616 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.424712 (+ 3096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.426346 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.428400 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.429026 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.429158 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.434461 (+ 5303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:55155: BlockingRecv error: recv got EOF from 127.20.245.129:55155 (error 108)
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":118,"threads_started":1}
W20260806 13:02:00.435061 30531 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:36315 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.245.190:36315: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.442355 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.435430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:35979)
0806 13:02:00.435574 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.435587 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.435653 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.435864 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.435865 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.436050 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.436123 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.436126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.436937 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.436939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.437506 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.437507 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.437940 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.437942 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.438187 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.438909 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.438915 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.442251 (+ 3336us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122}
W20260806 13:02:00.442509 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.435523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:35979 (local address 127.20.245.190:36315)
0806 13:02:00.435574 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.435576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.435631 (+ 55us) server_negotiation.cc:407] Connection header received
0806 13:02:00.435721 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.435722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.435752 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.435851 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.436230 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.436811 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.437605 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.437844 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.437929 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.442427 (+ 4498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:35979: BlockingRecv error: recv got EOF from 127.20.245.129:35979 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.449055 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.443002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:46325)
0806 13:02:00.443082 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.443095 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.443151 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.443368 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.443369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.443536 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.443595 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.443598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.444412 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.444414 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.445096 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.445100 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.445528 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.445530 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.445590 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.446257 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.446272 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.448735 (+ 2463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 13:02:00.449155 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.443089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:46325 (local address 127.20.245.190:36315)
0806 13:02:00.443146 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.443148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.443161 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:02:00.443268 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.443269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.443290 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.443360 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.443692 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.444252 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.445222 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.445446 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.445530 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.448977 (+ 3447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:46325: BlockingRecv error: recv got EOF from 127.20.245.129:46325 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260806 13:02:00.449674 30531 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 13:02:00.529198 30533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:00.529554 30533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:00.529603 30533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:00.531317 30533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:00.531461 30533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:00.531533 30533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:02:00.534278 30533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.130.keytab
--principal=oryx/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:35983
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=39299
--tserver_master_addrs=127.20.245.190:36315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:00.534880 30533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:00.535383 30533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:00.543326 30544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:00.543326 30542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:00.543362 30541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:00.544051 30533 server_base.cc:1034] running on GCE node
I20260806 13:02:00.544507 30533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:00.544864 30533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:00.546132 30533 hybrid_clock.cc:648] HybridClock initialized: now 1786021320546116 us; error 51 us; skew 500 ppm
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021320, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:02:00.552089 30533 init.cc:377] Logged in from keytab as oryx/127.20.245.130@KRBTEST.COM (short username oryx)
I20260806 13:02:00.552819 30533 webserver.cc:460] Webserver started at http://127.20.245.130:39299/ using document root <none> and password file <none>
I20260806 13:02:00.553176 30533 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:00.553303 30533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:00.555356 30533 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 13:02:00.556120 30551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.556428 30533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:02:00.556563 30533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "295fb4f34384436489a7b9e011a7e80c"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "24821560801f592a90f31f2805d50d63"
server_key_iv: "c4b57300d10f4d3b8e648915d4657e58"
server_key_version: "encryptionkey@0"
I20260806 13:02:00.557065 30533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:00.579763 30533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:00.583781 30533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:00.584035 30533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:00.584367 30533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:00.584833 30533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:00.584937 30533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.585005 30533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:00.585065 30533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.596463 30533 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:35983
I20260806 13:02:00.596654 30665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:35983 every 8 connection(s)
I20260806 13:02:00.597483 30533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:02:00.605468 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 30533
I20260806 13:02:00.605907 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:44611
--local_ip_for_outbound_sockets=127.20.245.131
--tserver_master_addrs=127.20.245.190:36315
--webserver_port=36521
--webserver_interface=127.20.245.131
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:35019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.245.131
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.610632 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.599310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:38541)
0806 13:02:00.599678 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.599737 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.600822 (+ 1085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.601339 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.601343 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.602096 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.602431 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.602438 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.603686 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.603687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.604996 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.604999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.605666 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.605667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.605839 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.606587 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.606598 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.610313 (+ 3715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":204,"threads_started":1}
W20260806 13:02:00.610745 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.599298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:38541 (local address 127.20.245.190:36315)
0806 13:02:00.599443 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.599447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.600084 (+ 637us) server_negotiation.cc:407] Connection header received
0806 13:02:00.600995 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.600996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.601024 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.601183 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.602574 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.603490 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.605193 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.605537 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.605664 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.610580 (+ 4916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:38541: BlockingRecv error: recv got EOF from 127.20.245.130:38541 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260806 13:02:00.611311 30666 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:36315 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.245.190:36315: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.618477 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.611652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:34411)
0806 13:02:00.611705 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.611717 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.611770 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.611937 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.611939 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.612140 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.612251 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.612255 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.613270 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.613271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.614008 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.614017 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.614488 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.614489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.614562 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.615143 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.615149 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.618381 (+ 3232us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 13:02:00.618815 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.611729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:34411 (local address 127.20.245.190:36315)
0806 13:02:00.611791 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.611794 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.611808 (+ 14us) server_negotiation.cc:407] Connection header received
0806 13:02:00.611853 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.611854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.611864 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.611934 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.612389 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.613107 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.614186 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.614398 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.614489 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.618653 (+ 4164us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:34411: BlockingRecv error: recv got EOF from 127.20.245.130:34411 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.628584 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.619316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:49937)
0806 13:02:00.619448 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.619469 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.619618 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.619887 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.619889 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.620234 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.620348 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.620352 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.621410 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.621411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.622944 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.622957 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.623683 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.623685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.623804 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.624817 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.624825 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.628470 (+ 3645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":82}
W20260806 13:02:00.628780 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.619403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:49937 (local address 127.20.245.190:36315)
0806 13:02:00.619495 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.619497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.619577 (+ 80us) server_negotiation.cc:407] Connection header received
0806 13:02:00.619758 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.619759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.619771 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.619851 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.620533 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.621251 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.623230 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.623533 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.623657 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.628627 (+ 4970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:49937: BlockingRecv error: recv got EOF from 127.20.245.130:49937 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 13:02:00.628790 30666 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 13:02:00.731330 30669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:00.731637 30669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:00.731668 30669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:00.733426 30669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:00.733549 30669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:00.733616 30669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:02:00.735579 30669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/krb5kdc/oryx_127.20.245.131.keytab
--principal=oryx/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:44611
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=36521
--tserver_master_addrs=127.20.245.190:36315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:00.735960 30669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:00.736270 30669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:00.743505 30674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:00.743520 30677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:00.743505 30675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:00.743788 30669 server_base.cc:1034] running on GCE node
I20260806 13:02:00.744211 30669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:00.744652 30669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:00.745823 30669 hybrid_clock.cc:648] HybridClock initialized: now 1786021320745809 us; error 39 us; skew 500 ppm
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021320, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:02:00.749013 30669 init.cc:377] Logged in from keytab as oryx/127.20.245.131@KRBTEST.COM (short username oryx)
I20260806 13:02:00.749730 30669 webserver.cc:460] Webserver started at http://127.20.245.131:36521/ using document root <none> and password file <none>
I20260806 13:02:00.750047 30669 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:00.750113 30669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:00.752425 30669 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:00.753468 30684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.753671 30669 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:00.753798 30669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "ebeb3fd4b78f40f5a48c1dddea92a9f5"
format_stamp: "Formatted at 2026-08-06 13:01:59 on dist-test-slave-srgv"
server_key: "58d89c049509146a5c4fb09b205d34ee"
server_key_iv: "3629b28916c73f88fab2a45dbbcf984d"
server_key_version: "encryptionkey@0"
I20260806 13:02:00.754215 30669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:00.791152 30669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:00.795401 30669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:00.795564 30669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:00.795893 30669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:00.796589 30669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:00.796666 30669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.796717 30669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:00.796736 30669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:00.807901 30669 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:44611
I20260806 13:02:00.807991 30800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:44611 every 8 connection(s)
I20260806 13:02:00.808512 30669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:02:00.816769 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 30669
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.826086 30803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.809808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:33263)
0806 13:02:00.810130 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.810195 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.811142 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.811748 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.811754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.813129 (+ 1375us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.813504 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.813511 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.814987 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.814988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.816573 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.816577 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.817462 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.817467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.817695 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.818801 (+ 1106us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.818864 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.825723 (+ 6859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":120,"threads_started":1}
W20260806 13:02:00.826201 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.809796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:33263 (local address 127.20.245.190:36315)
0806 13:02:00.809950 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.809978 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.810351 (+ 373us) server_negotiation.cc:407] Connection header received
0806 13:02:00.811430 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.811432 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.811463 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.811590 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.813767 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.814714 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.816693 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.816992 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.817140 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.826017 (+ 8877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:33263: BlockingRecv error: recv got EOF from 127.20.245.131:33263 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 13:02:00.827265 30801 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:36315 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.245.190:36315: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.837487 30803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.827934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:44359)
0806 13:02:00.828068 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.828093 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.828247 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.828998 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.828999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.829325 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.829438 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.829445 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.830975 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.830978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.831858 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.831860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.832609 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.832618 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.832906 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.834299 (+ 1393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.834312 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.837305 (+ 2993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
I20260806 13:02:00.837617 30806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.818001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49638 (local address 127.20.245.190:36315)
0806 13:02:00.818497 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.818500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.818510 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:02:00.818567 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.818576 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.818621 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.818701 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.820910 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.822750 (+ 1840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.824771 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.825331 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.825404 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.830138 (+ 4734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:00.830158 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:00.830158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:02:00.830183 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:00.834680 (+ 4497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:00.835622 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:00.835627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:00.835627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:00.835808 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:00.836294 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:00.836295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:00.836295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:00.836644 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:00.836893 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:00.837089 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 13:02:00.837353 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":70,"threads_started":1}
W20260806 13:02:00.837589 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.828103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:44359 (local address 127.20.245.190:36315)
0806 13:02:00.828225 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.828228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.828242 (+ 14us) server_negotiation.cc:407] Connection header received
0806 13:02:00.828661 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.828662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.828677 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.828999 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.829573 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.830786 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.832044 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.832383 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.832576 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.837458 (+ 4882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:44359: BlockingRecv error: recv got EOF from 127.20.245.131:44359 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:00 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:00.846001 30803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:00.838044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:36509)
0806 13:02:00.838662 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:00.838673 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:00.838924 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:00.839243 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:00.839244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:00.839513 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:00.839599 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.839601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.840649 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.840650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.841519 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:00.841522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.842132 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.842133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:00.842210 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.842908 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:00.842912 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:00.845745 (+ 2833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":588}
W20260806 13:02:00.846078 30535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:00.838115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:36509 (local address 127.20.245.190:36315)
0806 13:02:00.838202 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:00.838204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:00.838745 (+ 541us) server_negotiation.cc:407] Connection header received
0806 13:02:00.839052 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:00.839053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:00.839080 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:00.839223 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:00.839733 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.840459 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.841688 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:00.841978 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:00.842140 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:00.845952 (+ 3812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:36509: BlockingRecv error: recv got EOF from 127.20.245.131:36509 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 13:02:00.846326 30801 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 13:02:01 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:01 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:01.459262 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:01.450617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:55519)
0806 13:02:01.450937 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:01.450962 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:01.451088 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:01.451611 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:01.451612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:01.452023 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:01.452153 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:01.452163 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.453203 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.453204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:01.454110 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:01.454114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.454693 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.454695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:01.454777 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:01.455732 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:01.455738 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:01.459078 (+ 3340us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":189,"threads_started":1}
W20260806 13:02:01.459542 30808 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:01.450763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:55519 (local address 127.20.245.190:36315)
0806 13:02:01.450962 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:01.450964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:01.451074 (+ 110us) server_negotiation.cc:407] Connection header received
0806 13:02:01.451433 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:01.451434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:01.451457 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:01.451554 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:01.452301 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.453057 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.454263 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.454542 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.454641 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:01.459445 (+ 4804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:55519: BlockingRecv error: recv got EOF from 127.20.245.129:55519 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":103,"threads_started":1}
Aug 06 13:02:01 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:01 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:01.637511 30809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:01.629567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:51573)
0806 13:02:01.629819 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:01.629832 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:01.629922 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:01.630212 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:01.630213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:01.630476 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:01.630565 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:01.630567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.631575 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.631576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:01.632598 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:01.632603 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.633271 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.633272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:01.633503 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:01.634243 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:01.634250 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:01.637386 (+ 3136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":158,"threads_started":1}
W20260806 13:02:01.637620 30808 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:01.629715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:51573 (local address 127.20.245.190:36315)
0806 13:02:01.629855 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:01.629857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:01.629905 (+ 48us) server_negotiation.cc:407] Connection header received
0806 13:02:01.629990 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:01.629991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:01.630010 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:01.630097 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:01.630716 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.631446 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.632718 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.633084 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.633170 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:01.637542 (+ 4372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:51573: BlockingRecv error: recv got EOF from 127.20.245.130:51573 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 13:02:01 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:01 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:01.854610 30810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:01.846998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:45041)
0806 13:02:01.847346 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:01.847361 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:01.847488 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:01.847749 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:01.847750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:01.848025 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:01.848109 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:01.848112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.849016 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.849018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:01.849965 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:01.849969 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.850764 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.850766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:01.850866 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:01.851727 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:01.851734 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:01.854479 (+ 2745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":274,"threads_started":1}
W20260806 13:02:01.854717 30808 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:01.847152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:45041 (local address 127.20.245.190:36315)
0806 13:02:01.847327 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:01.847331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:01.847459 (+ 128us) server_negotiation.cc:407] Connection header received
0806 13:02:01.847598 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:01.847599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:01.847624 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:01.847736 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:01.848228 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.848864 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.850161 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:01.850660 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:01.850760 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:01.854635 (+ 3875us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:45041: BlockingRecv error: recv got EOF from 127.20.245.131:45041 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
Aug 06 13:02:02 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:02 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:02.466981 30811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:02.460122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:53861)
0806 13:02:02.460388 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:02.460409 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:02.460540 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:02.460773 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:02.460774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:02.461021 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:02.461100 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:02.461103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.462101 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.462103 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:02.462816 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:02.462821 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.463451 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.463452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:02.463521 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:02.464130 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:02.464135 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:02.466861 (+ 2726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":145,"threads_started":1}
W20260806 13:02:02.467329 30812 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:02.460268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:53861 (local address 127.20.245.190:36315)
0806 13:02:02.460437 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:02.460439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:02.460543 (+ 104us) server_negotiation.cc:407] Connection header received
0806 13:02:02.460617 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:02.460618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:02.460635 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:02.460756 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:02.461212 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.461974 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.462965 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.463342 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.463447 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:02.467094 (+ 3647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:53861: BlockingRecv error: recv got EOF from 127.20.245.129:53861 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":82,"threads_started":1}
Aug 06 13:02:02 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:02 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:02.645233 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:02.638416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:46483)
0806 13:02:02.638657 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:02.638669 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:02.638741 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:02.638957 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:02.638959 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:02.639310 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:02.639396 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:02.639401 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.640298 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.640299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:02.640911 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:02.640914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.641428 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.641429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:02.641487 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:02.642495 (+ 1008us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:02.642500 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:02.645105 (+ 2605us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":127,"threads_started":1}
W20260806 13:02:02.645321 30812 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:02.638632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:46483 (local address 127.20.245.190:36315)
0806 13:02:02.638731 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:02.638733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:02.638748 (+ 15us) server_negotiation.cc:407] Connection header received
0806 13:02:02.638808 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:02.638809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:02.638823 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:02.638900 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:02.639540 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.640187 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.641033 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.641337 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.641421 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:02.645237 (+ 3816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:46483: BlockingRecv error: recv got EOF from 127.20.245.130:46483 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 13:02:02 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:02 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:02.862834 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:02.856155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:54805)
0806 13:02:02.856410 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:02.856424 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:02.856538 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:02.856754 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:02.856755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:02.856996 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:02.857069 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:02.857071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.857952 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.857953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:02.858765 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:02.858768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.859437 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.859438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:02.859511 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:02.860177 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:02.860182 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:02.862700 (+ 2518us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":126,"threads_started":1}
W20260806 13:02:02.862903 30812 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:02.856448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:54805 (local address 127.20.245.190:36315)
0806 13:02:02.856534 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:02.856536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:02.856549 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:02:02.856634 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:02.856635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:02.856650 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:02.856733 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:02.857174 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.857794 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.858998 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:02.859351 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:02.859440 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:02.862824 (+ 3384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:54805: BlockingRecv error: recv got EOF from 127.20.245.131:54805 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 06 13:02:03 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:03 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:03.473604 30815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:03.467758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:46889)
0806 13:02:03.467952 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:03.467966 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:03.468052 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:03.468280 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:03.468280 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:03.468537 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:03.468611 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:03.468613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.469381 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.469382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:03.469998 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:03.470000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.470433 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.470434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:03.470487 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:03.471056 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:03.471062 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:03.473525 (+ 2463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":119,"threads_started":1}
W20260806 13:02:03.473861 30816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:03.467822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:46889 (local address 127.20.245.190:36315)
0806 13:02:03.468031 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:03.468037 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:03.468049 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:02:03.468148 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:03.468148 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:03.468161 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:03.468257 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:03.468718 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.469297 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.470094 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.470347 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.470411 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:03.473743 (+ 3332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:46889: BlockingRecv error: recv got EOF from 127.20.245.129:46889 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":132,"threads_started":1}
Aug 06 13:02:03 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:03 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:03.652740 30817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:03.646042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:60841)
0806 13:02:03.646261 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:03.646276 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:03.646346 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:03.646521 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:03.646522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:03.646746 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:03.646819 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:03.646822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.647857 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.647859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:03.648465 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:03.648467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.648943 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.648944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:03.649000 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:03.649897 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:03.649903 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:03.652648 (+ 2745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":141,"threads_started":1}
W20260806 13:02:03.652931 30816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:03.646273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:60841 (local address 127.20.245.190:36315)
0806 13:02:03.646358 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:03.646364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:03.646376 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:02:03.646414 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:03.646415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:03.646428 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:03.646501 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:03.646945 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.647726 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.648581 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.648832 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.648920 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:03.652830 (+ 3910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:60841: BlockingRecv error: recv got EOF from 127.20.245.130:60841 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 13:02:03 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:03 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:03.870286 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:03.863671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:54161)
0806 13:02:03.863892 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:03.863904 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:03.863991 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:03.864227 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:03.864228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:03.864589 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:03.864676 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:03.864678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.865594 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.865597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:03.866192 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:03.866194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.866642 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.866643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:03.866708 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:03.867334 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:03.867340 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:03.870111 (+ 2771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":140,"threads_started":1}
W20260806 13:02:03.870398 30816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:03.863797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:54161 (local address 127.20.245.190:36315)
0806 13:02:03.863892 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:03.863900 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:03.864006 (+ 106us) server_negotiation.cc:407] Connection header received
0806 13:02:03.864092 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:03.864093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:03.864108 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:03.864191 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:03.864805 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.865467 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.866300 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:03.866521 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:03.866590 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:03.870286 (+ 3696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:54161: BlockingRecv error: recv got EOF from 127.20.245.131:54161 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 13:02:04 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:04 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:04.481436 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:04.474605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:59151)
0806 13:02:04.474902 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:04.474922 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:04.475051 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:04.475349 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:04.475351 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:04.475684 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:04.475812 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:04.475816 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.476689 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.476690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:04.477347 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:04.477350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.477822 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.477824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:04.477877 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:04.478529 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:04.478545 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:04.481351 (+ 2806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":162,"threads_started":1}
W20260806 13:02:04.481614 30820 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:04.474714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:59151 (local address 127.20.245.190:36315)
0806 13:02:04.475062 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:04.475074 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:04.475118 (+ 44us) server_negotiation.cc:407] Connection header received
0806 13:02:04.475158 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:04.475159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:04.475210 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:04.475304 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:04.475947 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.476567 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.477454 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.477724 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.477791 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:04.481506 (+ 3715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:59151: BlockingRecv error: recv got EOF from 127.20.245.129:59151 (error 108)
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":191,"threads_started":1}
Aug 06 13:02:04 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:04 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:04.668864 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:04.653490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:45875)
0806 13:02:04.653882 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:04.653905 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:04.654099 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:04.654499 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:04.654500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:04.655005 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:04.655093 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:04.655096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.656019 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.656020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:04.656631 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:04.656633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.657056 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.657058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:04.657119 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:04.665632 (+ 8513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:04.665645 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:04.668718 (+ 3073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":201,"threads_started":1}
W20260806 13:02:04.669301 30820 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:04.653708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:45875 (local address 127.20.245.190:36315)
0806 13:02:04.653840 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:04.653856 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:04.654044 (+ 188us) server_negotiation.cc:407] Connection header received
0806 13:02:04.654315 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:04.654322 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:04.654353 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:04.654483 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:04.655231 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.655907 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.656755 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.656971 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.657059 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:04.669185 (+ 12126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:45875: BlockingRecv error: recv got EOF from 127.20.245.130:45875 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 13:02:04 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:04 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:04.878659 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:04.871294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:37573)
0806 13:02:04.871529 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:04.871547 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:04.871637 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:04.871970 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:04.871972 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:04.872211 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:04.872296 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:04.872299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.873262 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.873264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:04.873914 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:04.873917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.874446 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.874448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:04.874632 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:04.875826 (+ 1194us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:04.875832 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:04.878554 (+ 2722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":99,"threads_started":1}
W20260806 13:02:04.878805 30820 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:04.871703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:37573 (local address 127.20.245.190:36315)
0806 13:02:04.871772 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:04.871775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:04.871786 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:02:04.871826 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:04.871827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:04.871844 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:04.871915 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:04.872431 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.873125 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.874046 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:04.874311 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:04.874417 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:04.878697 (+ 4280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:37573: BlockingRecv error: recv got EOF from 127.20.245.131:37573 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 06 13:02:05 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:05 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:05.489439 30823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:05.482063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:51369)
0806 13:02:05.482346 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:05.482367 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:05.482464 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:05.482713 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:05.482715 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:05.483055 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:05.483131 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:05.483135 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.484112 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.484114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:05.484904 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:05.484908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.485710 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.485711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:05.485821 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:05.486703 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:05.486710 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:05.489330 (+ 2620us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":196,"threads_started":1}
W20260806 13:02:05.489593 30824 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:05.482143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:51369 (local address 127.20.245.190:36315)
0806 13:02:05.482407 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:05.482410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:05.482438 (+ 28us) server_negotiation.cc:407] Connection header received
0806 13:02:05.482570 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:05.482572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:05.482601 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:05.482701 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:05.483312 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.483949 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.485138 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.485509 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.485696 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:05.489493 (+ 3797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:51369: BlockingRecv error: recv got EOF from 127.20.245.129:51369 (error 108)
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":110,"threads_started":1}
Aug 06 13:02:05 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:05 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:05.676535 30825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:05.669785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:48601)
0806 13:02:05.670027 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:05.670043 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:05.670131 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:05.670331 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:05.670332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:05.670579 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:05.670649 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:05.670651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.671564 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.671565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:05.672142 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:05.672144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.672754 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.672755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:05.672822 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:05.673503 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:05.673510 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:05.676446 (+ 2936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":104,"threads_started":1}
W20260806 13:02:05.676811 30824 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:05.670020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:48601 (local address 127.20.245.190:36315)
0806 13:02:05.670175 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:05.670178 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:05.670188 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:02:05.670225 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:05.670225 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:05.670239 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:05.670299 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:05.670770 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.671477 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.672337 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.672571 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.672656 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:05.676734 (+ 4078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:48601: BlockingRecv error: recv got EOF from 127.20.245.130:48601 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
Aug 06 13:02:05 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:05 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:05.885921 30826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:05.879563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:58077)
0806 13:02:05.879772 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:05.879784 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:05.879856 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:05.880010 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:05.880011 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:05.880226 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:05.880298 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:05.880300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.881275 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.881276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:05.881903 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:05.881907 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.882410 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.882411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:05.882469 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:05.883155 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:05.883161 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:05.885798 (+ 2637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":93,"threads_started":1}
W20260806 13:02:05.885993 30824 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:05.879642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:58077 (local address 127.20.245.190:36315)
0806 13:02:05.879757 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:05.879760 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:05.879841 (+ 81us) server_negotiation.cc:407] Connection header received
0806 13:02:05.879914 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:05.879916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:05.879935 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:05.880003 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:05.880421 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.881079 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.882028 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:05.882328 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:05.882395 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:05.885913 (+ 3518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:58077: BlockingRecv error: recv got EOF from 127.20.245.131:58077 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 06 13:02:06 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:06 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:06.497761 30827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:06.490314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:57647)
0806 13:02:06.490574 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:06.490589 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:06.490704 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:06.491050 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:06.491055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:06.491402 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:06.491476 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:06.491479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.492480 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.492482 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:06.493225 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:06.493229 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.493743 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.493744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:06.493809 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:06.494517 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:06.494523 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:06.497635 (+ 3112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":157,"threads_started":1}
W20260806 13:02:06.497882 30828 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:06.490520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:57647 (local address 127.20.245.190:36315)
0806 13:02:06.490740 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:06.490743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:06.490767 (+ 24us) server_negotiation.cc:407] Connection header received
0806 13:02:06.490816 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:06.490823 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:06.490861 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:06.490996 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:06.491582 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.492309 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.493354 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.493590 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.493664 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:06.497791 (+ 4127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:57647: BlockingRecv error: recv got EOF from 127.20.245.129:57647 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":115,"threads_started":1}
Aug 06 13:02:06 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:06 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:06.684407 30829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:06.677506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:40533)
0806 13:02:06.677717 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:06.677801 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:06.677918 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:06.678141 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:06.678142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:06.678389 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:06.678460 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:06.678462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.679349 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.679351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:06.680009 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:06.680012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.680457 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.680458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:06.680520 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:06.681117 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:06.681122 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:06.684322 (+ 3200us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":120,"threads_started":1}
W20260806 13:02:06.684609 30828 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:06.677694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:40533 (local address 127.20.245.190:36315)
0806 13:02:06.677852 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:06.677855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:06.677888 (+ 33us) server_negotiation.cc:407] Connection header received
0806 13:02:06.678022 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:06.678024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:06.678045 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:06.678115 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:06.678582 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.679237 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.680100 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.680375 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.680459 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:06.684533 (+ 4074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:40533: BlockingRecv error: recv got EOF from 127.20.245.130:40533 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 06 13:02:06 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:06 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:06.892771 30830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:06.886653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:34687)
0806 13:02:06.886894 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:06.886911 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:06.887031 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:06.887249 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:06.887250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:06.887495 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:06.887563 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:06.887565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.888354 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.888355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:06.888946 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:06.888949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.889367 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.889368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:06.889444 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:06.890204 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:06.890210 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:06.892667 (+ 2457us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":157,"threads_started":1}
W20260806 13:02:06.892895 30828 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:06.886720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:34687 (local address 127.20.245.190:36315)
0806 13:02:06.886815 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:06.886819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:06.886998 (+ 179us) server_negotiation.cc:407] Connection header received
0806 13:02:06.887113 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:06.887114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:06.887137 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:06.887230 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:06.887661 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.888238 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.889056 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:06.889271 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:06.889364 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:06.892813 (+ 3449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:34687: BlockingRecv error: recv got EOF from 127.20.245.131:34687 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 13:02:07 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:07 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:07.505636 30831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:07.498616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:39921)
0806 13:02:07.498906 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:07.498920 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:07.498998 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:07.499204 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:07.499205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:07.499604 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:07.499699 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:07.499703 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.500818 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.500820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:07.501697 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:07.501701 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.502269 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.502271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:07.502336 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:07.503051 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:07.503057 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:07.505518 (+ 2461us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":183,"threads_started":1}
W20260806 13:02:07.505749 30832 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:07.498791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:39921 (local address 127.20.245.190:36315)
0806 13:02:07.498990 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:07.498992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:07.499003 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:02:07.499058 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:07.499059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:07.499073 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:07.499142 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:07.499822 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.500698 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.501845 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.502079 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.502176 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:07.505660 (+ 3484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:39921: BlockingRecv error: recv got EOF from 127.20.245.129:39921 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":108,"threads_started":1}
Aug 06 13:02:07 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:07 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:07.691421 30833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:07.685222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:56239)
0806 13:02:07.685467 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:07.685481 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:07.685583 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:07.685800 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:07.685801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:07.686024 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:07.686104 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:07.686106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.687011 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.687013 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:07.687709 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:07.687713 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.688164 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.688165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:07.688269 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:07.688946 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:07.688952 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:07.691337 (+ 2385us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":101,"threads_started":1}
W20260806 13:02:07.691731 30832 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:07.685379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:56239 (local address 127.20.245.190:36315)
0806 13:02:07.685456 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:07.685458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:07.685617 (+ 159us) server_negotiation.cc:407] Connection header received
0806 13:02:07.685662 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:07.685664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:07.685681 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:07.685747 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:07.686243 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.686895 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.687827 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.688074 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.688157 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:07.691587 (+ 3430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:56239: BlockingRecv error: recv got EOF from 127.20.245.130:56239 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 06 13:02:07 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:07 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:07.900271 30834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:07.893667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:40689)
0806 13:02:07.893918 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:07.893933 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:07.894016 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:07.894470 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:07.894471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:07.894698 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:07.894792 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:07.894794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.895742 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.895743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:07.896334 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:07.896337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.896758 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.896759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:07.896815 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:07.897444 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:07.897450 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:07.900175 (+ 2725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":114,"threads_started":1}
W20260806 13:02:07.900491 30832 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:07.893827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:40689 (local address 127.20.245.190:36315)
0806 13:02:07.893965 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:07.893967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:07.894024 (+ 57us) server_negotiation.cc:407] Connection header received
0806 13:02:07.894086 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:07.894088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:07.894272 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:07.894425 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:07.894891 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.895633 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.896441 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:07.896652 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:07.896717 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:07.900410 (+ 3693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:40689: BlockingRecv error: recv got EOF from 127.20.245.131:40689 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 06 13:02:08 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:08 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:08.512617 30835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:08.506388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:43125)
0806 13:02:08.506598 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:08.506616 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:08.506726 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:08.506936 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:08.506938 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:08.507222 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:08.507296 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:08.507298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.508126 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.508128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:08.508771 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:08.508775 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.509258 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.509259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:08.509342 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:08.509993 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:08.509999 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:08.512502 (+ 2503us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":125,"threads_started":1}
W20260806 13:02:08.512818 30836 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:08.506552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:43125 (local address 127.20.245.190:36315)
0806 13:02:08.506750 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:08.506752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:08.506763 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:02:08.506800 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:08.506801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:08.506815 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:08.506917 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:08.507417 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.508011 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.508902 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.509160 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.509254 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:08.512691 (+ 3437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:43125: BlockingRecv error: recv got EOF from 127.20.245.129:43125 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":90,"threads_started":1}
Aug 06 13:02:08 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:08 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:08.698040 30837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:08.692164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:33877)
0806 13:02:08.692404 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:08.692421 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:08.692506 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:08.692682 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:08.692683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:08.692909 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:08.692980 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:08.692982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.693951 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.693953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:08.694521 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:08.694523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.694967 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.694968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:08.695015 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:08.695763 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:08.695769 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:08.697960 (+ 2191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":154,"threads_started":1}
W20260806 13:02:08.698225 30836 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:08.692345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:33877 (local address 127.20.245.190:36315)
0806 13:02:08.692451 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:08.692453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:08.692504 (+ 51us) server_negotiation.cc:407] Connection header received
0806 13:02:08.692588 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:08.692589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:08.692602 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:08.692667 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:08.693064 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.693841 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.694631 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.694878 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.694950 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:08.698113 (+ 3163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:33877: BlockingRecv error: recv got EOF from 127.20.245.130:33877 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 13:02:08 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:08 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:08.907380 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:08.900978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:39179)
0806 13:02:08.901197 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:08.901210 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:08.901297 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:08.901530 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:08.901532 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:08.901833 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:08.901921 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:08.901924 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.902784 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.902785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:08.903502 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:08.903506 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.903997 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.903998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:08.904062 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:08.904866 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:08.904871 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:08.907264 (+ 2393us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":108,"threads_started":1}
W20260806 13:02:08.907466 30836 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:08.901100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:39179 (local address 127.20.245.190:36315)
0806 13:02:08.901201 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:08.901204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:08.901346 (+ 142us) server_negotiation.cc:407] Connection header received
0806 13:02:08.901384 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:08.901385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:08.901407 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:08.901456 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:08.902055 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.902645 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.903628 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:08.903881 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:08.903955 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:08.907389 (+ 3434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:39179: BlockingRecv error: recv got EOF from 127.20.245.131:39179 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 13:02:09 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:09 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:09.519987 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:09.513514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:37991)
0806 13:02:09.513799 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:09.513813 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:09.513899 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:09.514073 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:09.514074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:09.514310 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:09.514382 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:09.514384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.515311 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.515313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:09.516003 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:09.516008 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.516610 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.516611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:09.516704 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:09.517441 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:09.517447 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:09.519891 (+ 2444us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":154,"threads_started":1}
W20260806 13:02:09.520123 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:09.513696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:37991 (local address 127.20.245.190:36315)
0806 13:02:09.513891 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:09.513893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:09.513912 (+ 19us) server_negotiation.cc:407] Connection header received
0806 13:02:09.513962 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:09.513963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:09.513978 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:09.514038 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:09.514500 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.515105 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.516133 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.516500 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.516630 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:09.520029 (+ 3399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:37991: BlockingRecv error: recv got EOF from 127.20.245.129:37991 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":111,"threads_started":1}
Aug 06 13:02:09 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:09 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:09.712852 30842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:09.699098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:34447)
0806 13:02:09.699345 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:09.699362 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:09.699479 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:09.699743 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:09.699745 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:09.700032 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:09.700197 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:09.700202 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.701393 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.701395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:09.702039 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:09.702043 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.702677 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.702678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:09.702755 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:09.709316 (+ 6561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:09.709326 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:09.712744 (+ 3418us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":153,"threads_started":1}
W20260806 13:02:09.713049 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:09.699245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:34447 (local address 127.20.245.190:36315)
0806 13:02:09.699348 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:09.699351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:09.699462 (+ 111us) server_negotiation.cc:407] Connection header received
0806 13:02:09.699576 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:09.699577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:09.699593 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:09.699673 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:09.700373 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.701262 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.702304 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.702542 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.702642 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:09.712929 (+ 10287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:34447: BlockingRecv error: recv got EOF from 127.20.245.130:34447 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 13:02:09 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:09 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:09.915243 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:09.908292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:57443)
0806 13:02:09.908534 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:09.908547 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:09.908660 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:09.908846 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:09.908848 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:09.909091 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:09.909268 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:09.909272 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.910319 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.910321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:09.910921 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:09.910924 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.911482 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.911484 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:09.911579 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:09.912292 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:09.912298 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:09.915073 (+ 2775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":148,"threads_started":1}
W20260806 13:02:09.915452 30841 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:09.908424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:57443 (local address 127.20.245.190:36315)
0806 13:02:09.908511 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:09.908514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:09.908630 (+ 116us) server_negotiation.cc:407] Connection header received
0806 13:02:09.908739 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:09.908741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:09.908759 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:09.908834 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:09.909477 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.910193 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.911045 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:09.911370 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:09.911479 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:09.915348 (+ 3869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:57443: BlockingRecv error: recv got EOF from 127.20.245.131:57443 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 13:02:10 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:10 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:10.527503 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:10.520783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:35021)
0806 13:02:10.521046 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:10.521062 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:10.521146 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:10.521342 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:10.521343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:10.521560 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:10.521632 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:10.521635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.522476 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.522478 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:10.523069 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:10.523072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.523600 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.523603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:10.523670 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:10.524398 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:10.524404 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:10.527421 (+ 3017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":187,"threads_started":1}
W20260806 13:02:10.527766 30845 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:10.520987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:35021 (local address 127.20.245.190:36315)
0806 13:02:10.521163 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:10.521166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:10.521206 (+ 40us) server_negotiation.cc:407] Connection header received
0806 13:02:10.521239 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:10.521240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:10.521255 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:10.521318 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:10.521744 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.522365 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.523256 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.523481 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.523552 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:10.527607 (+ 4055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:35021: BlockingRecv error: recv got EOF from 127.20.245.129:35021 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
Aug 06 13:02:10 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:10 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:10.720237 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:10.713769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:53395)
0806 13:02:10.714031 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:10.714046 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:10.714136 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:10.714523 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:10.714525 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:10.714782 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:10.714859 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:10.714862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.715820 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.715822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:10.716478 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:10.716482 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.716953 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.716954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:10.717016 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:10.717754 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:10.717760 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:10.720148 (+ 2388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":112,"threads_started":1}
W20260806 13:02:10.720525 30845 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:10.713937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:53395 (local address 127.20.245.190:36315)
0806 13:02:10.714045 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:10.714047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:10.714181 (+ 134us) server_negotiation.cc:407] Connection header received
0806 13:02:10.714346 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:10.714348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:10.714377 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:10.714449 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:10.714972 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.715690 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.716590 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.716822 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.716891 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:10.720433 (+ 3542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:53395: BlockingRecv error: recv got EOF from 127.20.245.130:53395 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 13:02:10 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:10 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:10.923377 30847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:10.916047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:48627)
0806 13:02:10.916303 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:10.916324 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:10.916400 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:10.916667 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:10.916668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:10.916888 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:10.916960 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:10.916962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.917958 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.917959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:10.918599 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:10.918604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.919080 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.919081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:10.919140 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:10.920165 (+ 1025us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:10.920173 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:10.923236 (+ 3063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":127,"threads_started":1}
W20260806 13:02:10.923597 30845 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:10.916346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:48627 (local address 127.20.245.190:36315)
0806 13:02:10.916447 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:10.916449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:10.916459 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:02:10.916493 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:10.916494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:10.916510 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:10.916568 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:10.917097 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.917797 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.918739 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:10.918968 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:10.919042 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:10.923519 (+ 4477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:48627: BlockingRecv error: recv got EOF from 127.20.245.131:48627 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 06 13:02:11 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:11 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:11.535475 30848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:11.528354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:44719)
0806 13:02:11.528652 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:11.528668 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:11.528761 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:11.528999 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:11.529001 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:11.529295 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:11.529362 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:11.529365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.530327 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.530328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:11.530960 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:11.530962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.531585 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.531587 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:11.531652 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:11.532514 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:11.532520 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:11.535372 (+ 2852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":151,"threads_started":1}
W20260806 13:02:11.535775 30849 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:11.528525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:44719 (local address 127.20.245.190:36315)
0806 13:02:11.528742 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:11.528744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:11.528757 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:02:11.528844 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:11.528845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:11.528859 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:11.528934 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:11.529504 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.530201 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.531226 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.531488 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.531562 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:11.535693 (+ 4131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:44719: BlockingRecv error: recv got EOF from 127.20.245.129:44719 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":142,"threads_started":1}
Aug 06 13:02:11 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:11 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:11.727761 30850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:11.721175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:41817)
0806 13:02:11.721464 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:11.721477 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:11.721562 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:11.721974 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:11.721975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:11.722273 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:11.722364 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:11.722367 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.723142 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.723143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:11.723773 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:11.723776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.724255 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.724256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:11.724339 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:11.724961 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:11.724967 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:11.727632 (+ 2665us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":190,"threads_started":1}
W20260806 13:02:11.727867 30849 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:11.721245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:41817 (local address 127.20.245.190:36315)
0806 13:02:11.721389 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:11.721392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:11.721571 (+ 179us) server_negotiation.cc:407] Connection header received
0806 13:02:11.721695 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:11.721696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:11.721714 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:11.721897 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:11.722445 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.723034 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.723888 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.724151 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.724243 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:11.727793 (+ 3550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:41817: BlockingRecv error: recv got EOF from 127.20.245.130:41817 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 06 13:02:11 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:11 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:11.930029 30851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:11.924014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:50469)
0806 13:02:11.924205 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:11.924218 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:11.924353 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:11.924520 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:11.924522 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:11.924742 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:11.924810 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:11.924812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.925626 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.925627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:11.926222 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:11.926224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.926611 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.926611 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:11.926658 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:11.927357 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:11.927363 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:11.929928 (+ 2565us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":109,"threads_started":1}
W20260806 13:02:11.930320 30849 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:11.924154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:50469 (local address 127.20.245.190:36315)
0806 13:02:11.924241 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:11.924243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:11.924355 (+ 112us) server_negotiation.cc:407] Connection header received
0806 13:02:11.924421 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:11.924422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:11.924442 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:11.924493 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:11.924885 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.925510 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.926319 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:11.926534 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:11.926595 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:11.930211 (+ 3616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:50469: BlockingRecv error: recv got EOF from 127.20.245.131:50469 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 06 13:02:12 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:12 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:12.543452 30852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:12.536346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:55197)
0806 13:02:12.536552 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:12.536572 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:12.536646 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:12.536903 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:12.536904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:12.537148 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:12.537223 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:12.537225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.538169 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.538170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:12.538961 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:12.538965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.539609 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.539611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:12.539691 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:12.540399 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:12.540406 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:12.543343 (+ 2937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":119,"threads_started":1}
W20260806 13:02:12.543589 30853 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:12.536512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:55197 (local address 127.20.245.190:36315)
0806 13:02:12.536701 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:12.536703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:12.536713 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:02:12.536766 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:12.536767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:12.536781 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:12.536868 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:12.537369 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.538022 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.539049 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.539456 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.539538 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:12.543498 (+ 3960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:55197: BlockingRecv error: recv got EOF from 127.20.245.129:55197 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":107,"threads_started":1}
Aug 06 13:02:12 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:12 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:12.735438 30854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:12.728585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:36027)
0806 13:02:12.728937 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:12.728953 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:12.729053 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:12.729331 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:12.729332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:12.729580 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:12.729654 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:12.729657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.730554 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.730555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:12.731143 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:12.731145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.731705 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.731706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:12.731761 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:12.732465 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:12.732471 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:12.735338 (+ 2867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":176,"threads_started":1}
W20260806 13:02:12.735565 30853 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:12.728700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:36027 (local address 127.20.245.190:36315)
0806 13:02:12.728794 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:12.728797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:12.729128 (+ 331us) server_negotiation.cc:407] Connection header received
0806 13:02:12.729170 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:12.729171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:12.729187 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:12.729253 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:12.729810 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.730437 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.731395 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.731624 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.731689 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:12.735477 (+ 3788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:36027: BlockingRecv error: recv got EOF from 127.20.245.130:36027 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 06 13:02:12 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:12 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:12.937489 30855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:12.930924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:50159)
0806 13:02:12.931158 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:12.931226 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:12.931332 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:12.931543 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:12.931545 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:12.931845 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:12.931917 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:12.931920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.932877 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.932879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:12.933511 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:12.933513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.933945 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.933947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:12.934021 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:12.934734 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:12.934741 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:12.937402 (+ 2661us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":150,"threads_started":1}
W20260806 13:02:12.937721 30853 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:12.931108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:50159 (local address 127.20.245.190:36315)
0806 13:02:12.931221 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:12.931223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:12.931328 (+ 105us) server_negotiation.cc:407] Connection header received
0806 13:02:12.931395 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:12.931396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:12.931413 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:12.931481 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:12.932035 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.932755 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.933617 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:12.933846 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:12.933948 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:12.937589 (+ 3641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:50159: BlockingRecv error: recv got EOF from 127.20.245.131:50159 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 06 13:02:13 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:13 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:13.550590 30856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:13.544422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:51033)
0806 13:02:13.544627 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:13.544640 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:13.544710 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:13.544975 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:13.544976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:13.545205 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:13.545277 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:13.545280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.546083 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.546085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:13.546722 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:13.546725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.547169 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.547276 (+ 107us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:13.547356 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:13.548030 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:13.548036 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:13.550513 (+ 2477us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":105,"threads_started":1}
W20260806 13:02:13.550844 30857 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:13.544567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:51033 (local address 127.20.245.190:36315)
0806 13:02:13.544783 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:13.544786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:13.544801 (+ 15us) server_negotiation.cc:407] Connection header received
0806 13:02:13.544841 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:13.544842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:13.544858 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:13.544952 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:13.545391 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.545978 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.546826 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.547044 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.547116 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:13.550744 (+ 3628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:51033: BlockingRecv error: recv got EOF from 127.20.245.129:51033 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":135,"threads_started":1}
Aug 06 13:02:13 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:13 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:13.742235 30858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:13.736151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:47305)
0806 13:02:13.736351 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:13.736364 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:13.736450 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:13.736662 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:13.736663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:13.736972 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:13.737070 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:13.737072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.737980 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.737982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:13.738576 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:13.738579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.739043 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.739043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:13.739092 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:13.739800 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:13.739805 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:13.742154 (+ 2349us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":108,"threads_started":1}
W20260806 13:02:13.742415 30857 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:13.736264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:47305 (local address 127.20.245.190:36315)
0806 13:02:13.736332 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:13.736334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:13.736448 (+ 114us) server_negotiation.cc:407] Connection header received
0806 13:02:13.736514 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:13.736515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:13.736548 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:13.736629 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:13.737263 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.737876 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.738693 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.738960 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.739033 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:13.742329 (+ 3296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:47305: BlockingRecv error: recv got EOF from 127.20.245.130:47305 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 06 13:02:13 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:13 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:13.944532 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:13.938323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:33587)
0806 13:02:13.938559 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:13.938572 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:13.938663 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:13.938846 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:13.938846 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:13.939075 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:13.939170 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:13.939172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.940112 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.940114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:13.940799 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:13.940802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.941243 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.941245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:13.941318 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:13.941970 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:13.941975 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:13.944414 (+ 2439us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":120,"threads_started":1}
W20260806 13:02:13.944617 30857 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:13.938399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:33587 (local address 127.20.245.190:36315)
0806 13:02:13.938486 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:13.938488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:13.938689 (+ 201us) server_negotiation.cc:407] Connection header received
0806 13:02:13.938727 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:13.938728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:13.938747 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:13.938810 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:13.939430 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.940016 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.940907 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:13.941122 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:13.941243 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:13.944537 (+ 3294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:33587: BlockingRecv error: recv got EOF from 127.20.245.131:33587 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 06 13:02:14 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:14 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:14.557598 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:14.551383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:41945)
0806 13:02:14.551560 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:14.551572 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:14.551641 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:14.551922 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:14.551923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:14.552145 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:14.552234 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:14.552237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.553347 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.553349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:14.553948 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:14.553950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.554394 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.554395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:14.554457 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:14.555100 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:14.555106 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:14.557447 (+ 2341us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
W20260806 13:02:14.557776 30861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:14.551499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:41945 (local address 127.20.245.190:36315)
0806 13:02:14.551662 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:14.551669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:14.551680 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:02:14.551758 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:14.551759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:14.551775 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:14.551889 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:14.552332 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.553270 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.554024 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.554294 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.554361 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:14.557664 (+ 3303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:41945: BlockingRecv error: recv got EOF from 127.20.245.129:41945 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":97,"threads_started":1}
Aug 06 13:02:14 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:14 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:14.754994 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:14.742962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:45607)
0806 13:02:14.743155 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:14.743217 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:14.743316 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:14.743506 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:14.743507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:14.743752 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:14.743848 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:14.743851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.744732 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.744734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:14.745344 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:14.745346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.745741 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.745743 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:14.745812 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:14.752558 (+ 6746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:14.752565 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:14.754879 (+ 2314us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":110,"threads_started":1}
W20260806 13:02:14.755125 30861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:14.743140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:45607 (local address 127.20.245.190:36315)
0806 13:02:14.743244 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:14.743248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:14.743290 (+ 42us) server_negotiation.cc:407] Connection header received
0806 13:02:14.743404 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:14.743405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:14.743420 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:14.743481 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:14.743958 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.744614 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.745451 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.745661 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.745744 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:14.755049 (+ 9305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:45607: BlockingRecv error: recv got EOF from 127.20.245.130:45607 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 13:02:14 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:14 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.131@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:14.951820 30863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:14.945365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.131:41949)
0806 13:02:14.945561 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:14.945601 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:14.945682 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:14.945907 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:14.945909 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:14.946134 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:14.946203 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:14.946205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.946992 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.946993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:14.947628 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:14.947630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.948001 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.948002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:14.948053 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:14.948679 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:14.948684 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:14.951677 (+ 2993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":114,"threads_started":1}
W20260806 13:02:14.951877 30861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:14.945500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:41949 (local address 127.20.245.190:36315)
0806 13:02:14.945596 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:14.945598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:14.945676 (+ 78us) server_negotiation.cc:407] Connection header received
0806 13:02:14.945761 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:14.945762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:14.945787 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:14.945837 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:14.946328 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.946908 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.947710 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:14.947933 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:14.947987 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:14.951794 (+ 3807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.131:41949: BlockingRecv error: recv got EOF from 127.20.245.131:41949 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 06 13:02:15 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:15 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.129@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:15.569742 30864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:15.558270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.129:34917)
0806 13:02:15.558472 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:15.558485 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:15.558570 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:15.558730 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:15.558731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:15.559000 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:15.559070 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:15.559073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:15.559956 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:15.559957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:15.560602 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:15.560605 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:15.560993 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:15.560994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:15.561040 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:15.566831 (+ 5791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:15.566840 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:15.569658 (+ 2818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":114,"threads_started":1}
W20260806 13:02:15.569947 30865 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:15.558363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:34917 (local address 127.20.245.190:36315)
0806 13:02:15.558504 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:15.558506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:15.558564 (+ 58us) server_negotiation.cc:407] Connection header received
0806 13:02:15.558634 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:15.558635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:15.558651 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:15.558713 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:15.559151 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:15.559862 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:15.560679 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:15.560920 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:15.560982 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:15.569831 (+ 8849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.129:34917: BlockingRecv error: recv got EOF from 127.20.245.129:34917 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":69,"threads_started":1}
Aug 06 13:02:15 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 13:02:15 dist-test-slave-srgv krb5kdc[29785](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.245.130@KRBTEST.COM for oryx/127.20.245.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 13:02:15.762238 30866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:15.755850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36315 (local address 127.20.245.130:45835)
0806 13:02:15.756123 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:15.756138 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:15.756267 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:15.756466 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:15.756467 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:15.756730 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:15.756795 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:15.756798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:15.757784 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:15.757786 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:15.758573 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:15.758577 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:15.758973 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:15.758974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:15.759017 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:15.759767 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:15.759773 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:15.762079 (+ 2306us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.245.190:36315: Server oryx/127.20.245.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":117,"threads_started":1}
W20260806 13:02:15.762356 30865 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:15.755983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:45835 (local address 127.20.245.190:36315)
0806 13:02:15.756093 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:15.756095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:15.756231 (+ 136us) server_negotiation.cc:407] Connection header received
0806 13:02:15.756368 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:15.756369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:15.756384 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:15.756456 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:15.756894 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:15.757687 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:15.758672 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:15.758899 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:15.758962 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:15.762250 (+ 3288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.245.130:45835: BlockingRecv error: recv got EOF from 127.20.245.130:45835 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 13:02:15.825158 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 30381
I20260806 13:02:15.831534 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 30533
I20260806 13:02:15.837554 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 30669
I20260806 13:02:15.843340 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 30307
2026-08-06T13:02:15Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18162 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T13:02:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:02:15Z Disabled control of system clock
I20260806 13:02:15.876726 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36687
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:41609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:36687
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 13:02:15.975324 30870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:15.975623 30870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:15.975649 30870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:15.977190 30870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:02:15.977258 30870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:15.977272 30870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:15.977285 30870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:02:15.977298 30870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:02:15.978960 30870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:41609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:36687
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:15.979377 30870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:15.979795 30870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:15.986056 30876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:15.986239 30870 server_base.cc:1034] running on GCE node
W20260806 13:02:15.986056 30875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:15.986454 30878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:15.986935 30870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:15.987474 30870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:15.988673 30870 hybrid_clock.cc:648] HybridClock initialized: now 1786021335988654 us; error 46 us; skew 500 ppm
I20260806 13:02:15.990525 30870 webserver.cc:460] Webserver started at http://127.20.245.190:33233/ using document root <none> and password file <none>
I20260806 13:02:15.990867 30870 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:15.990948 30870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:15.991125 30870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:15.992574 30870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "2e185620ff8040a3a80f47a9d150e4bc"
format_stamp: "Formatted at 2026-08-06 13:02:15 on dist-test-slave-srgv"
server_key: "ecbd9f0ff5ed8682d4d61d83157806bb"
server_key_iv: "54e4ba65c687d14b8388759186e2d35f"
server_key_version: "encryptionkey@0"
I20260806 13:02:15.993038 30870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "2e185620ff8040a3a80f47a9d150e4bc"
format_stamp: "Formatted at 2026-08-06 13:02:15 on dist-test-slave-srgv"
server_key: "ecbd9f0ff5ed8682d4d61d83157806bb"
server_key_iv: "54e4ba65c687d14b8388759186e2d35f"
server_key_version: "encryptionkey@0"
I20260806 13:02:15.994834 30870 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:02:15.996016 30885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:15.996349 30870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:02:15.996534 30870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "2e185620ff8040a3a80f47a9d150e4bc"
format_stamp: "Formatted at 2026-08-06 13:02:15 on dist-test-slave-srgv"
server_key: "ecbd9f0ff5ed8682d4d61d83157806bb"
server_key_iv: "54e4ba65c687d14b8388759186e2d35f"
server_key_version: "encryptionkey@0"
I20260806 13:02:15.996655 30870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:16.010002 30870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:16.010524 30870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:16.010721 30870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:16.016579 30870 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:36687
I20260806 13:02:16.016620 30937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:36687 every 8 connection(s)
I20260806 13:02:16.017112 30870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:02:16.018108 30938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:02:16.022341 30938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc: Bootstrap starting.
I20260806 13:02:16.023321 30938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc: Neither blocks nor log segments found. Creating new log.
I20260806 13:02:16.023389 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 30870
I20260806 13:02:16.023490 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:02:16.023792 21462 external_mini_cluster.cc:1428] Setting key c697b525dfc7aca8fefc37a93f522c91
I20260806 13:02:16.023862 30938 log.cc:824] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc: Log is configured to *not* fsync() on all Append() calls
I20260806 13:02:16.025003 30938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc: No bootstrap required, opened a new log
I20260806 13:02:16.027884 30938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e185620ff8040a3a80f47a9d150e4bc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36687 } }
I20260806 13:02:16.028155 30938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:02:16.028211 30938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e185620ff8040a3a80f47a9d150e4bc, State: Initialized, Role: FOLLOWER
I20260806 13:02:16.028396 30938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e185620ff8040a3a80f47a9d150e4bc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36687 } }
I20260806 13:02:16.028836 30938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:02:16.028896 30938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:02:16.028964 30938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:02:16.030071 30938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e185620ff8040a3a80f47a9d150e4bc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36687 } }
I20260806 13:02:16.030229 30938 leader_election.cc:302] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e185620ff8040a3a80f47a9d150e4bc; no voters:
I20260806 13:02:16.030493 30938 leader_election.cc:288] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:02:16.030575 30943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:02:16.030853 30943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [term 1 LEADER]: Becoming Leader. State: Replica: 2e185620ff8040a3a80f47a9d150e4bc, State: Running, Role: LEADER
I20260806 13:02:16.030988 30938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:02:16.030998 30943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e185620ff8040a3a80f47a9d150e4bc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36687 } }
I20260806 13:02:16.031589 30946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e185620ff8040a3a80f47a9d150e4bc. Latest consensus state: current_term: 1 leader_uuid: "2e185620ff8040a3a80f47a9d150e4bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e185620ff8040a3a80f47a9d150e4bc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36687 } } }
I20260806 13:02:16.031787 30946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [sys.catalog]: This master's current role is: LEADER
I20260806 13:02:16.032120 30950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:02:16.032790 30944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e185620ff8040a3a80f47a9d150e4bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e185620ff8040a3a80f47a9d150e4bc" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36687 } } }
I20260806 13:02:16.032938 30944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc [sys.catalog]: This master's current role is: LEADER
I20260806 13:02:16.032843 30950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:02:16.032804 30942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.024669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37964 (local address 127.20.245.190:36687)
0806 13:02:16.024956 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:16.024969 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:16.025008 (+ 39us) server_negotiation.cc:407] Connection header received
0806 13:02:16.025779 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:16.025794 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:16.025912 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:16.026135 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:16.026451 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.028028 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.029328 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.030070 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.030258 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:16.031422 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:16.031428 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:16.031428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:02:16.031702 (+ 274us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:16.031764 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:02:16.031787 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:16.031869 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:16.032346 (+ 477us) server_negotiation.cc:299] Negotiation successful
0806 13:02:16.032468 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":115,"threads_started":1}
I20260806 13:02:16.035415 30950 catalog_manager.cc:1347] Generated new cluster ID: 4b8169cac5a84e3b9fb68f228ab1034f
I20260806 13:02:16.035495 30950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:02:16.053900 30950 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:02:16.054849 30950 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:02:16.061079 30950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e185620ff8040a3a80f47a9d150e4bc: Generated new TSK 0
I20260806 13:02:16.061435 30950 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:02:16.068841 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36687
--builtin_ntp_servers=127.20.245.148:41609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 13:02:16.170008 30963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:16.170372 30963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:16.170419 30963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:16.172043 30963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:16.172152 30963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:16.172315 30963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:02:16.174443 30963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:41609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:16.174887 30963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:16.175345 30963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:02:16.181670 30963 server_base.cc:1034] running on GCE node
W20260806 13:02:16.181619 30969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.181835 30971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.181619 30968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:16.182245 30963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:16.182626 30963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:16.183846 30963 hybrid_clock.cc:648] HybridClock initialized: now 1786021336183832 us; error 37 us; skew 500 ppm
I20260806 13:02:16.185580 30963 webserver.cc:460] Webserver started at http://127.20.245.129:37279/ using document root <none> and password file <none>
I20260806 13:02:16.185958 30963 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:16.186038 30963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:16.186200 30963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:16.187681 30963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "267d4cbe42704136937760a06aeaa02c"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "1aa81e30da4e6d33206e74c170607c6b"
server_key_iv: "03190c7fb7776f3572b9892bf8751aa7"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.188138 30963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "267d4cbe42704136937760a06aeaa02c"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "1aa81e30da4e6d33206e74c170607c6b"
server_key_iv: "03190c7fb7776f3572b9892bf8751aa7"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.189674 30963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:02:16.190578 30977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.190775 30963 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:16.190913 30963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "267d4cbe42704136937760a06aeaa02c"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "1aa81e30da4e6d33206e74c170607c6b"
server_key_iv: "03190c7fb7776f3572b9892bf8751aa7"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.191004 30963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:16.201479 30963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:16.201941 30963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:16.202114 30963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:16.202411 30963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:16.202828 30963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:16.202885 30963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.202948 30963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:16.202993 30963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.210384 30963 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:38057
I20260806 13:02:16.210439 31094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:38057 every 8 connection(s)
I20260806 13:02:16.210875 30963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:02:16.216459 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 30963
I20260806 13:02:16.216641 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:02:16.216908 21462 external_mini_cluster.cc:1428] Setting key 3082341af06447190a445eeb5a4a5641
I20260806 13:02:16.217549 30942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.211870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:40101 (local address 127.20.245.190:36687)
0806 13:02:16.211959 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:16.211962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:16.212305 (+ 343us) server_negotiation.cc:407] Connection header received
0806 13:02:16.212930 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:16.212931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:16.212949 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:16.213000 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:16.213875 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.214439 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.215585 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.215802 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.215864 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:16.217153 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:16.217156 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:16.217156 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:02:16.217164 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:16.217214 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:02:16.217219 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:16.217277 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:16.217424 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 13:02:16.217470 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 13:02:16.217876 31097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.211832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36687 (local address 127.20.245.129:40101)
0806 13:02:16.212159 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:16.212203 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:16.212814 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:16.213125 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:16.213130 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:16.213141 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:16.213786 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:16.213792 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.214532 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.214533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:16.215503 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:16.215506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.215916 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.215917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:16.216074 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:16.216913 (+ 839us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:02:16.216914 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:16.216952 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:02:16.216981 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:16.217306 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:16.217316 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:16.217320 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:02:16.217426 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 13:02:16.217570 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":123,"threads_started":1}
I20260806 13:02:16.218254 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36687
--builtin_ntp_servers=127.20.245.148:41609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 13:02:16.218740 31095 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36687
I20260806 13:02:16.218886 31095 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:16.219233 31095 heartbeater.cc:511] Master 127.20.245.190:36687 requested a full tablet report, sending...
I20260806 13:02:16.220041 30902 ts_manager.cc:194] Registered new tserver with Master: 267d4cbe42704136937760a06aeaa02c (127.20.245.129:38057)
I20260806 13:02:16.220857 30902 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.129:40101
W20260806 13:02:16.320405 31098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:16.320755 31098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:16.320802 31098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:16.322345 31098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:16.322436 31098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:16.322485 31098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:02:16.324193 31098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:41609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:16.324589 31098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:16.325011 31098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:16.331121 31104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.331131 31106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.331135 31103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:16.331699 31098 server_base.cc:1034] running on GCE node
I20260806 13:02:16.332015 31098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:16.332336 31098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:16.333508 31098 hybrid_clock.cc:648] HybridClock initialized: now 1786021336333496 us; error 36 us; skew 500 ppm
I20260806 13:02:16.335165 31098 webserver.cc:460] Webserver started at http://127.20.245.130:36413/ using document root <none> and password file <none>
I20260806 13:02:16.335574 31098 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:16.335629 31098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:16.335747 31098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:16.336985 31098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "675af0a8ee374e2e82253156f88332af"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "55ca5e7e3d82200e6edf73f2efdffa5f"
server_key_iv: "c62cf9371d53694cb9a7a29c4d35de98"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.337348 31098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "675af0a8ee374e2e82253156f88332af"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "55ca5e7e3d82200e6edf73f2efdffa5f"
server_key_iv: "c62cf9371d53694cb9a7a29c4d35de98"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.338886 31098 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 13:02:16.339959 31112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.340188 31098 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:16.340308 31098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "675af0a8ee374e2e82253156f88332af"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "55ca5e7e3d82200e6edf73f2efdffa5f"
server_key_iv: "c62cf9371d53694cb9a7a29c4d35de98"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.340400 31098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:16.350519 31098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:16.350937 31098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:16.351214 31098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:16.351536 31098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:16.351930 31098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:16.351984 31098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.352031 31098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:16.352067 31098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.359148 31098 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:41795
I20260806 13:02:16.359342 31227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:41795 every 8 connection(s)
I20260806 13:02:16.359743 31098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:02:16.366080 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 31098
I20260806 13:02:16.366310 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:02:16.366632 21462 external_mini_cluster.cc:1428] Setting key 7fe0745417a80a2444f559d8c5f5d075
I20260806 13:02:16.366636 30942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.360784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:36353 (local address 127.20.245.190:36687)
0806 13:02:16.360866 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:16.360869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:16.361079 (+ 210us) server_negotiation.cc:407] Connection header received
0806 13:02:16.361716 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:16.361717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:16.361732 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:16.361809 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:16.362648 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.363449 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.364708 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.364958 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.365035 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:16.366242 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:16.366244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:16.366244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:02:16.366255 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:16.366280 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:02:16.366286 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:16.366346 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:16.366513 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 13:02:16.366549 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 13:02:16.367125 31230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.360697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36687 (local address 127.20.245.130:36353)
0806 13:02:16.360920 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:16.360972 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:16.361612 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:16.361898 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:16.361902 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:16.361912 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:16.362532 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:16.362537 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.363580 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.363581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:16.364588 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:16.364592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.365056 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.365057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:16.365227 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:16.365978 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:02:16.365979 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:16.366032 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:02:16.366071 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:16.366360 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:16.366369 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:16.366373 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:02:16.366506 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 13:02:16.366666 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260806 13:02:16.367826 31228 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36687
I20260806 13:02:16.367964 31228 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:16.367980 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36687
--builtin_ntp_servers=127.20.245.148:41609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 13:02:16.368260 31228 heartbeater.cc:511] Master 127.20.245.190:36687 requested a full tablet report, sending...
I20260806 13:02:16.368767 30902 ts_manager.cc:194] Registered new tserver with Master: 675af0a8ee374e2e82253156f88332af (127.20.245.130:41795)
I20260806 13:02:16.369244 30902 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.130:36353
W20260806 13:02:16.475975 31231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:16.476289 31231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:16.476318 31231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:16.477777 31231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:16.477833 31231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:16.477862 31231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:02:16.479427 31231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:41609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:16.479739 31231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:16.480114 31231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:02:16.486718 31231 server_base.cc:1034] running on GCE node
W20260806 13:02:16.486694 31239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.486694 31237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.486694 31236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:16.487365 31231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:16.487717 31231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:16.488916 31231 hybrid_clock.cc:648] HybridClock initialized: now 1786021336488888 us; error 56 us; skew 500 ppm
I20260806 13:02:16.490670 31231 webserver.cc:460] Webserver started at http://127.20.245.131:44613/ using document root <none> and password file <none>
I20260806 13:02:16.491020 31231 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:16.491079 31231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:16.491266 31231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:16.492667 31231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "8355254b12da4d89a316169ecb49a407"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "0f8e1f163131e4d9d9c05633dd0d4ac1"
server_key_iv: "b9da0c35e953b7e4812e3d39ff36571b"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.493106 31231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "8355254b12da4d89a316169ecb49a407"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "0f8e1f163131e4d9d9c05633dd0d4ac1"
server_key_iv: "b9da0c35e953b7e4812e3d39ff36571b"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.494863 31231 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:02:16.495947 31245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.496132 31231 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:16.496233 31231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "8355254b12da4d89a316169ecb49a407"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "0f8e1f163131e4d9d9c05633dd0d4ac1"
server_key_iv: "b9da0c35e953b7e4812e3d39ff36571b"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.496316 31231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:16.508713 31231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:16.509140 31231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:16.509269 31231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:16.509536 31231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:16.509902 31231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:16.509935 31231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.509963 31231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:16.509976 31231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.517688 31231 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:42233
I20260806 13:02:16.517836 31360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:42233 every 8 connection(s)
I20260806 13:02:16.518224 31231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:02:16.525125 30942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.519252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:48183 (local address 127.20.245.190:36687)
0806 13:02:16.519318 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:16.519320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:16.519637 (+ 317us) server_negotiation.cc:407] Connection header received
0806 13:02:16.520278 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:16.520280 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:16.520295 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:16.520361 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:16.521131 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.521689 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.522941 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.523247 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.523336 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:16.524593 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:16.524596 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:16.524596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:02:16.524604 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:16.524627 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:02:16.524632 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:16.524805 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:16.524939 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 13:02:16.525004 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:02:16.525549 31363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.519228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36687 (local address 127.20.245.131:48183)
0806 13:02:16.519463 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:16.519505 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:16.520129 (+ 624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:16.520427 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:16.520431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:16.520442 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:16.521049 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:16.521053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.521824 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.521826 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:16.522816 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:16.522820 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:16.523353 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:16.523355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:16.523511 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:16.524365 (+ 854us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:02:16.524366 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:16.524412 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:02:16.524449 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:16.524813 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:16.524823 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:16.524829 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:02:16.524943 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 13:02:16.525115 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260806 13:02:16.525583 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 31231
I20260806 13:02:16.525703 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:02:16.525955 21462 external_mini_cluster.cc:1428] Setting key 25a4353c1b1bcef3f3ea7c19f72760eb
I20260806 13:02:16.526254 31361 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36687
I20260806 13:02:16.526407 31361 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:16.526741 31361 heartbeater.cc:511] Master 127.20.245.190:36687 requested a full tablet report, sending...
I20260806 13:02:16.527338 30902 ts_manager.cc:194] Registered new tserver with Master: 8355254b12da4d89a316169ecb49a407 (127.20.245.131:42233)
I20260806 13:02:16.527793 30902 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.131:48183
I20260806 13:02:16.538878 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 13:02:16.541808 30942 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:16.540933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37968 (local address 127.20.245.190:36687)
0806 13:02:16.541024 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:16.541028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:16.541240 (+ 212us) server_negotiation.cc:407] Connection header received
0806 13:02:16.541316 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:16.541317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:16.541330 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:16.541392 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:16.541639 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37968: BlockingRecv error: recv got EOF from 127.0.0.1:37968 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 13:02:16.541857 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 30963
I20260806 13:02:16.548771 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 31098
I20260806 13:02:16.555135 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 31231
I20260806 13:02:16.561764 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 30870
2026-08-06T13:02:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (716 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T13:02:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:02:16Z Disabled control of system clock
I20260806 13:02:16.595295 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35521
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:35397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:35521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 13:02:16.701563 31372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:16.701961 31372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:16.701989 31372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:16.703440 31372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:02:16.703493 31372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:16.703507 31372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:16.703521 31372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:02:16.703560 31372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:02:16.705096 31372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:35521
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:16.705438 31372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:16.705821 31372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:16.711696 31380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.711678 31377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.711678 31378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:16.711715 31372 server_base.cc:1034] running on GCE node
I20260806 13:02:16.712287 31372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:16.712673 31372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:16.713841 31372 hybrid_clock.cc:648] HybridClock initialized: now 1786021336713816 us; error 38 us; skew 500 ppm
I20260806 13:02:16.715508 31372 webserver.cc:460] Webserver started at http://127.20.245.190:36357/ using document root <none> and password file <none>
I20260806 13:02:16.715876 31372 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:16.715972 31372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:16.716195 31372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:16.717998 31372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "077e614c2ec141fbbc88b1811d59c161"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "123a58f7182cfe9778dd97ddabadbeae"
server_key_iv: "9cae075c5673a2513d8b0e8b18aab7cc"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.718472 31372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "077e614c2ec141fbbc88b1811d59c161"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "123a58f7182cfe9778dd97ddabadbeae"
server_key_iv: "9cae075c5673a2513d8b0e8b18aab7cc"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.720305 31372 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 13:02:16.721190 31386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.721395 31372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:16.721508 31372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "077e614c2ec141fbbc88b1811d59c161"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "123a58f7182cfe9778dd97ddabadbeae"
server_key_iv: "9cae075c5673a2513d8b0e8b18aab7cc"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.721593 31372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:16.726166 31372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:16.726574 31372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:16.726749 31372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:16.732177 31372 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:35521
I20260806 13:02:16.732203 31438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:35521 every 8 connection(s)
I20260806 13:02:16.732796 31372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:02:16.733758 31439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:02:16.737519 31439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161: Bootstrap starting.
I20260806 13:02:16.738373 31439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161: Neither blocks nor log segments found. Creating new log.
I20260806 13:02:16.738801 31439 log.cc:824] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161: Log is configured to *not* fsync() on all Append() calls
I20260806 13:02:16.739918 31439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161: No bootstrap required, opened a new log
I20260806 13:02:16.742044 31439 raft_consensus.cc:348] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077e614c2ec141fbbc88b1811d59c161" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35521 } }
I20260806 13:02:16.742254 31439 raft_consensus.cc:374] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:02:16.742281 31439 raft_consensus.cc:729] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 077e614c2ec141fbbc88b1811d59c161, State: Initialized, Role: FOLLOWER
I20260806 13:02:16.742465 31439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077e614c2ec141fbbc88b1811d59c161" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35521 } }
I20260806 13:02:16.742545 31439 raft_consensus.cc:388] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:02:16.742585 31439 raft_consensus.cc:482] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:02:16.742635 31439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:02:16.742643 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 31372
I20260806 13:02:16.742771 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:02:16.743018 21462 external_mini_cluster.cc:1428] Setting key 381072dd3206d4bd52f7bdf781879484
I20260806 13:02:16.743628 31439 raft_consensus.cc:504] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077e614c2ec141fbbc88b1811d59c161" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35521 } }
I20260806 13:02:16.743873 31439 leader_election.cc:302] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 077e614c2ec141fbbc88b1811d59c161; no voters:
I20260806 13:02:16.744112 31439 leader_election.cc:288] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:02:16.744145 31444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:02:16.744294 31444 raft_consensus.cc:686] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [term 1 LEADER]: Becoming Leader. State: Replica: 077e614c2ec141fbbc88b1811d59c161, State: Running, Role: LEADER
I20260806 13:02:16.744488 31439 sys_catalog.cc:564] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:02:16.744444 31444 consensus_queue.cc:237] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077e614c2ec141fbbc88b1811d59c161" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35521 } }
I20260806 13:02:16.745816 31445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "077e614c2ec141fbbc88b1811d59c161" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077e614c2ec141fbbc88b1811d59c161" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35521 } } }
I20260806 13:02:16.745923 31445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [sys.catalog]: This master's current role is: LEADER
I20260806 13:02:16.746007 31446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 077e614c2ec141fbbc88b1811d59c161. Latest consensus state: current_term: 1 leader_uuid: "077e614c2ec141fbbc88b1811d59c161" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077e614c2ec141fbbc88b1811d59c161" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35521 } } }
I20260806 13:02:16.746074 31446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161 [sys.catalog]: This master's current role is: LEADER
I20260806 13:02:16.746333 31443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.743746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35748 (local address 127.20.245.190:35521)
0806 13:02:16.744038 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:16.744050 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:16.744085 (+ 35us) server_negotiation.cc:407] Connection header received
0806 13:02:16.744246 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:16.744256 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:16.744319 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:16.744826 (+ 507us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:16.745375 (+ 549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:16.745379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:16.745380 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:02:16.745385 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:16.745444 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:02:16.745464 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:16.745532 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:16.745829 (+ 297us) server_negotiation.cc:299] Negotiation successful
0806 13:02:16.745906 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":123,"threads_started":1}
I20260806 13:02:16.746408 31456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:02:16.747140 31456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:02:16.749166 31456 catalog_manager.cc:1347] Generated new cluster ID: 3137542faaa14445aa95b7ff39f2bb50
I20260806 13:02:16.749225 31456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:02:16.762290 31456 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:02:16.762499 31456 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:02:16.764945 31456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 077e614c2ec141fbbc88b1811d59c161: Generated new TSK 0
I20260806 13:02:16.765194 31456 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:02:16.775556 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35521
--builtin_ntp_servers=127.20.245.148:35397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 13:02:16.878367 31464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:16.878652 31464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:16.878680 31464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:16.880152 31464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:16.880214 31464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:16.880249 31464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:02:16.881832 31464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:16.882179 31464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:16.882612 31464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:16.888688 31470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:16.888679 31469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:16.888948 31464 server_base.cc:1034] running on GCE node
W20260806 13:02:16.888674 31472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:16.889477 31464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:16.889824 31464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:16.891031 31464 hybrid_clock.cc:648] HybridClock initialized: now 1786021336891007 us; error 44 us; skew 500 ppm
I20260806 13:02:16.892936 31464 webserver.cc:460] Webserver started at http://127.20.245.129:41193/ using document root <none> and password file <none>
I20260806 13:02:16.893225 31464 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:16.893306 31464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:16.893476 31464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:16.895069 31464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "5c01e6fcd1e7450f93fcec6cc3faa5d2"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "7a73834ce486fed9bbb09622dddf5d98"
server_key_iv: "842e73f4efb60ba380b9825407977ae8"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.895602 31464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "5c01e6fcd1e7450f93fcec6cc3faa5d2"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "7a73834ce486fed9bbb09622dddf5d98"
server_key_iv: "842e73f4efb60ba380b9825407977ae8"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.897495 31464 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:02:16.898662 31478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.898913 31464 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:16.899040 31464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "5c01e6fcd1e7450f93fcec6cc3faa5d2"
format_stamp: "Formatted at 2026-08-06 13:02:16 on dist-test-slave-srgv"
server_key: "7a73834ce486fed9bbb09622dddf5d98"
server_key_iv: "842e73f4efb60ba380b9825407977ae8"
server_key_version: "encryptionkey@0"
I20260806 13:02:16.899142 31464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:16.903431 31464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:16.903805 31464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:16.903967 31464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:16.904208 31464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:16.904614 31464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:16.904672 31464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.904719 31464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:16.904745 31464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:16.912060 31464 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:44425
I20260806 13:02:16.912106 31593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:44425 every 8 connection(s)
I20260806 13:02:16.912562 31464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:02:16.913389 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 31464
I20260806 13:02:16.913528 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:02:16.913792 21462 external_mini_cluster.cc:1428] Setting key 5059a966ceacd4f3919abc08f7f577b2
I20260806 13:02:16.915122 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35521
--builtin_ntp_servers=127.20.245.148:35397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 13:02:16.917042 31443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.913524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:35295 (local address 127.20.245.190:35521)
0806 13:02:16.913593 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:16.913596 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:16.913935 (+ 339us) server_negotiation.cc:407] Connection header received
0806 13:02:16.914641 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:16.914642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:16.914652 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:16.914725 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:16.916712 (+ 1987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:16.916714 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:16.916714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:02:16.916721 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:16.916749 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:02:16.916756 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:16.916827 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:16.916940 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 13:02:16.916961 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 13:02:16.917361 31596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:16.913493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35521 (local address 127.20.245.129:35295)
0806 13:02:16.913741 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:16.913806 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:16.914519 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:16.914839 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:16.914844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:16.914857 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:16.916455 (+ 1598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:02:16.916457 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:16.916515 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:02:16.916571 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:16.916840 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:16.916848 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:16.916852 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:02:16.916951 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 13:02:16.917052 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":110,"threads_started":1}
I20260806 13:02:16.918081 31594 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35521
I20260806 13:02:16.918236 31594 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:16.918452 31594 heartbeater.cc:511] Master 127.20.245.190:35521 requested a full tablet report, sending...
I20260806 13:02:16.919154 31403 ts_manager.cc:194] Registered new tserver with Master: 5c01e6fcd1e7450f93fcec6cc3faa5d2 (127.20.245.129:44425)
W20260806 13:02:17.014956 31597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:17.015352 31597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:17.015388 31597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:17.016928 31597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:17.016992 31597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:17.017025 31597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:02:17.018675 31597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:17.019032 31597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:17.019476 31597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:17.025701 31605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:17.025879 31602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:17.025725 31603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:17.025775 31597 server_base.cc:1034] running on GCE node
I20260806 13:02:17.026219 31597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:17.026620 31597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:17.027794 31597 hybrid_clock.cc:648] HybridClock initialized: now 1786021337027779 us; error 33 us; skew 500 ppm
I20260806 13:02:17.029799 31597 webserver.cc:460] Webserver started at http://127.20.245.130:39129/ using document root <none> and password file <none>
I20260806 13:02:17.030141 31597 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:17.030261 31597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:17.030457 31597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:17.031893 31597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "0132d0cd34b5498ca2132410056f58ef"
format_stamp: "Formatted at 2026-08-06 13:02:17 on dist-test-slave-srgv"
server_key: "cad530f4b9fc9eb08c52979d95ba91d3"
server_key_iv: "8576a50f9b80fa106de2020fbe7a9d41"
server_key_version: "encryptionkey@0"
I20260806 13:02:17.032342 31597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "0132d0cd34b5498ca2132410056f58ef"
format_stamp: "Formatted at 2026-08-06 13:02:17 on dist-test-slave-srgv"
server_key: "cad530f4b9fc9eb08c52979d95ba91d3"
server_key_iv: "8576a50f9b80fa106de2020fbe7a9d41"
server_key_version: "encryptionkey@0"
I20260806 13:02:17.034402 31597 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:02:17.035696 31612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:17.035913 31597 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:02:17.036041 31597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "0132d0cd34b5498ca2132410056f58ef"
format_stamp: "Formatted at 2026-08-06 13:02:17 on dist-test-slave-srgv"
server_key: "cad530f4b9fc9eb08c52979d95ba91d3"
server_key_iv: "8576a50f9b80fa106de2020fbe7a9d41"
server_key_version: "encryptionkey@0"
I20260806 13:02:17.036208 31597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:17.040625 31597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:17.041002 31597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:17.041177 31597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:17.041429 31597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:17.041833 31597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:17.041887 31597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:17.041934 31597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:17.041966 31597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:17.049448 31597 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:43067
I20260806 13:02:17.049496 31728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:43067 every 8 connection(s)
I20260806 13:02:17.049957 31597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:02:17.053558 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 31597
I20260806 13:02:17.053735 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:02:17.053782 31443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:17.050931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:55961 (local address 127.20.245.190:35521)
0806 13:02:17.051017 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:17.051019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:17.051318 (+ 299us) server_negotiation.cc:407] Connection header received
0806 13:02:17.051973 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:17.051975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:17.051985 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:17.052050 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:17.053461 (+ 1411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:17.053463 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:17.053463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:02:17.053469 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:17.053496 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:02:17.053501 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:17.053575 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:17.053668 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 13:02:17.053688 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:02:17.054026 31731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:17.050937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35521 (local address 127.20.245.130:55961)
0806 13:02:17.051148 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:17.051209 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:17.051841 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:17.052143 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:17.052147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:17.052157 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:17.053268 (+ 1111us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:02:17.053269 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:17.053309 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:02:17.053347 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:17.053569 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:17.053576 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:17.053580 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:02:17.053683 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 13:02:17.053772 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":81,"threads_started":1}
I20260806 13:02:17.054033 21462 external_mini_cluster.cc:1428] Setting key e0ff1ade93d6b49aa678bdb7bf90bbf9
I20260806 13:02:17.054649 31729 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35521
I20260806 13:02:17.054774 31729 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:17.054965 31729 heartbeater.cc:511] Master 127.20.245.190:35521 requested a full tablet report, sending...
I20260806 13:02:17.055454 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35521
--builtin_ntp_servers=127.20.245.148:35397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 13:02:17.055459 31402 ts_manager.cc:194] Registered new tserver with Master: 0132d0cd34b5498ca2132410056f58ef (127.20.245.130:43067)
W20260806 13:02:17.149883 31732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:17.150166 31732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:17.150197 31732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:17.151676 31732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:17.151729 31732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:17.151763 31732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:02:17.153355 31732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:35397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:17.153683 31732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:17.154075 31732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:02:17.160145 31732 server_base.cc:1034] running on GCE node
W20260806 13:02:17.160195 31740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:17.160161 31738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:17.160358 31737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:17.160616 31732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:17.160953 31732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:17.162120 31732 hybrid_clock.cc:648] HybridClock initialized: now 1786021337162105 us; error 77 us; skew 500 ppm
I20260806 13:02:17.163827 31732 webserver.cc:460] Webserver started at http://127.20.245.131:33167/ using document root <none> and password file <none>
I20260806 13:02:17.164132 31732 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:17.164269 31732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:17.164431 31732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:17.165737 31732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "138874a1cf7a4ef787ac5bd1f4bc34de"
format_stamp: "Formatted at 2026-08-06 13:02:17 on dist-test-slave-srgv"
server_key: "22a56eff32030bc8081b632dfb659a63"
server_key_iv: "6979c8ca6e205b5377a0735ee2cf88b5"
server_key_version: "encryptionkey@0"
I20260806 13:02:17.166157 31732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "138874a1cf7a4ef787ac5bd1f4bc34de"
format_stamp: "Formatted at 2026-08-06 13:02:17 on dist-test-slave-srgv"
server_key: "22a56eff32030bc8081b632dfb659a63"
server_key_iv: "6979c8ca6e205b5377a0735ee2cf88b5"
server_key_version: "encryptionkey@0"
I20260806 13:02:17.167761 31732 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260806 13:02:17.168730 31746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:17.168920 31732 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:02:17.169080 31732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "138874a1cf7a4ef787ac5bd1f4bc34de"
format_stamp: "Formatted at 2026-08-06 13:02:17 on dist-test-slave-srgv"
server_key: "22a56eff32030bc8081b632dfb659a63"
server_key_iv: "6979c8ca6e205b5377a0735ee2cf88b5"
server_key_version: "encryptionkey@0"
I20260806 13:02:17.169178 31732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:17.173418 31732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:17.173779 31732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:17.173944 31732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:17.174198 31732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:17.174633 31732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:17.174693 31732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:17.174748 31732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:17.174783 31732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:17.182588 31732 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:41019
I20260806 13:02:17.182631 31860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:41019 every 8 connection(s)
I20260806 13:02:17.183126 31732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:02:17.187117 31443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:17.184262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:45239 (local address 127.20.245.190:35521)
0806 13:02:17.184363 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:17.184366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:17.184566 (+ 200us) server_negotiation.cc:407] Connection header received
0806 13:02:17.185211 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:17.185212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:17.185221 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:17.185292 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:17.186829 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:17.186832 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:17.186832 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:02:17.186838 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:17.186855 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:02:17.186861 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:17.186923 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:17.187008 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 13:02:17.187026 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 13:02:17.187484 31864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:17.184155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35521 (local address 127.20.245.131:45239)
0806 13:02:17.184400 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:17.184454 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:17.185099 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:17.185362 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:17.185366 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:17.185377 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:17.186628 (+ 1251us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:02:17.186629 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:17.186667 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:02:17.186706 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:17.186934 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:17.186939 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:17.186942 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:02:17.187015 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 13:02:17.187147 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":121,"threads_started":1}
I20260806 13:02:17.188097 31861 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35521
I20260806 13:02:17.188230 31861 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:17.188426 31861 heartbeater.cc:511] Master 127.20.245.190:35521 requested a full tablet report, sending...
I20260806 13:02:17.188992 31402 ts_manager.cc:194] Registered new tserver with Master: 138874a1cf7a4ef787ac5bd1f4bc34de (127.20.245.131:41019)
I20260806 13:02:17.192101 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 31732
I20260806 13:02:17.192219 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:02:17.192790 21462 external_mini_cluster.cc:1428] Setting key 088f44d5182921e222314907d14fb049
I20260806 13:02:17.194096 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 13:02:17.196470 31443 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:02:17.195851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35756 (local address 127.20.245.190:35521)
0806 13:02:17.195919 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:17.195922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:17.196009 (+ 87us) server_negotiation.cc:407] Connection header received
0806 13:02:17.196070 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:17.196071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:17.196077 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:17.196132 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:17.196368 (+ 236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35756: BlockingRecv error: recv got EOF from 127.0.0.1:35756 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 13:02:17.196472 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 31464
I20260806 13:02:17.203843 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 31597
I20260806 13:02:17.209991 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 31732
I20260806 13:02:17.216665 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 31372
2026-08-06T13:02:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (656 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:02:17 dist-test-slave-srgv krb5kdc[31872](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:02:17 dist-test-slave-srgv krb5kdc[31872](info): set up 2 sockets
Aug 06 13:02:17 dist-test-slave-srgv krb5kdc[31872](info): commencing operation
krb5kdc: starting...
W20260806 13:02:18.320520 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:02:18 dist-test-slave-srgv krb5kdc[31872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:02:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:02:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:02:18.467665 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46107
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:46107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:02:18.564800 31886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:18.565148 31886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:18.565204 31886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:18.566658 31886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:02:18.566756 31886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:18.566779 31886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:18.566802 31886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:02:18.566828 31886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:02:18.568804 31886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:46107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:18.569198 31886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:18.569494 31886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:18.576012 31892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:18.576012 31891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:18.576012 31894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:18.576323 31886 server_base.cc:1034] running on GCE node
I20260806 13:02:18.576678 31886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:18.577047 31886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:18.578254 31886 hybrid_clock.cc:648] HybridClock initialized: now 1786021338578235 us; error 38 us; skew 500 ppm
Aug 06 13:02:18 dist-test-slave-srgv krb5kdc[31872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021338, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:02:18.581640 31886 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:02:18.582213 31886 webserver.cc:460] Webserver started at http://127.20.245.190:45737/ using document root <none> and password file <none>
I20260806 13:02:18.582502 31886 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:18.582556 31886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:18.582737 31886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:18.584154 31886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "11069b1a1beb4bb2bc0217eba37f0d75"
format_stamp: "Formatted at 2026-08-06 13:02:18 on dist-test-slave-srgv"
server_key: "218721d9f653c72f691185828f94af6c"
server_key_iv: "fb91f0842e3eee0dc0cdeca1ec54ac93"
server_key_version: "encryptionkey@0"
I20260806 13:02:18.584585 31886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "11069b1a1beb4bb2bc0217eba37f0d75"
format_stamp: "Formatted at 2026-08-06 13:02:18 on dist-test-slave-srgv"
server_key: "218721d9f653c72f691185828f94af6c"
server_key_iv: "fb91f0842e3eee0dc0cdeca1ec54ac93"
server_key_version: "encryptionkey@0"
I20260806 13:02:18.586261 31886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 13:02:18.587338 31901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:18.587586 31886 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:18.587744 31886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "11069b1a1beb4bb2bc0217eba37f0d75"
format_stamp: "Formatted at 2026-08-06 13:02:18 on dist-test-slave-srgv"
server_key: "218721d9f653c72f691185828f94af6c"
server_key_iv: "fb91f0842e3eee0dc0cdeca1ec54ac93"
server_key_version: "encryptionkey@0"
I20260806 13:02:18.587844 31886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:18.601027 31886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:18.603927 31886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:18.604158 31886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:18.609910 31886 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:46107
I20260806 13:02:18.609989 31953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:46107 every 8 connection(s)
I20260806 13:02:18.610499 31886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:02:18.611845 31954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:02:18.615130 31954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75: Bootstrap starting.
I20260806 13:02:18.615346 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 31886
I20260806 13:02:18.615468 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:02:18.615751 21462 external_mini_cluster.cc:1428] Setting key 0bad0bf3dc79ed05433bafa8a5be8546
I20260806 13:02:18.616219 31954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75: Neither blocks nor log segments found. Creating new log.
I20260806 13:02:18.616647 31954 log.cc:824] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75: Log is configured to *not* fsync() on all Append() calls
I20260806 13:02:18.617616 31954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75: No bootstrap required, opened a new log
I20260806 13:02:18.620097 31954 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11069b1a1beb4bb2bc0217eba37f0d75" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46107 } }
I20260806 13:02:18.620316 31954 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:02:18.620373 31954 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11069b1a1beb4bb2bc0217eba37f0d75, State: Initialized, Role: FOLLOWER
I20260806 13:02:18.620558 31954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11069b1a1beb4bb2bc0217eba37f0d75" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46107 } }
I20260806 13:02:18.620672 31954 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:02:18.620723 31954 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:02:18.620780 31954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:02:18.621662 31954 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11069b1a1beb4bb2bc0217eba37f0d75" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46107 } }
I20260806 13:02:18.621814 31954 leader_election.cc:302] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11069b1a1beb4bb2bc0217eba37f0d75; no voters:
I20260806 13:02:18.622044 31954 leader_election.cc:288] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:02:18.622102 31959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:02:18.622332 31959 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [term 1 LEADER]: Becoming Leader. State: Replica: 11069b1a1beb4bb2bc0217eba37f0d75, State: Running, Role: LEADER
I20260806 13:02:18.622447 31954 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:02:18.622540 31959 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11069b1a1beb4bb2bc0217eba37f0d75" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46107 } }
I20260806 13:02:18.623087 31959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11069b1a1beb4bb2bc0217eba37f0d75. Latest consensus state: current_term: 1 leader_uuid: "11069b1a1beb4bb2bc0217eba37f0d75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11069b1a1beb4bb2bc0217eba37f0d75" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46107 } } }
I20260806 13:02:18.623667 31959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [sys.catalog]: This master's current role is: LEADER
Aug 06 13:02:18 dist-test-slave-srgv krb5kdc[31872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:02:18.623576 31961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11069b1a1beb4bb2bc0217eba37f0d75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11069b1a1beb4bb2bc0217eba37f0d75" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46107 } } }
I20260806 13:02:18.624154 31961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75 [sys.catalog]: This master's current role is: LEADER
I20260806 13:02:18.624336 31964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:02:18.625078 31964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:02:18.627679 31964 catalog_manager.cc:1347] Generated new cluster ID: 39ab443eb510459a87da1e2234e9d6a1
I20260806 13:02:18.627890 31964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:02:18.630581 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:18.616423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52850 (local address 127.20.245.190:46107)
0806 13:02:18.616696 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:18.616708 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:18.616784 (+ 76us) server_negotiation.cc:407] Connection header received
0806 13:02:18.617476 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:18.617487 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:18.617551 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:18.617730 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:18.618435 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:18.619449 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:18.620261 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:18.620926 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:18.621051 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:18.624835 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:18.624841 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:18.624841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:02:18.624864 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:18.628301 (+ 3437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:18.628931 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:18.628936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:18.628937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:18.629082 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:18.629328 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:18.629329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:18.629329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:18.629749 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:18.629949 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:18.630094 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 13:02:18.630284 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":108,"threads_started":1}
I20260806 13:02:18.637271 31964 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:02:18.638103 31964 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:02:18.642509 31964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75: Generated new TSK 0
I20260806 13:02:18.642841 31964 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:02:18.679236 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46107
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:02:18.799981 31981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:18.800292 31981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:18.800326 31981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:18.802001 31981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:18.802068 31981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:18.802103 31981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:02:18.804102 31981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:18.804507 31981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:18.804852 31981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:18.811421 31986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:18.811465 31989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:18.811421 31987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:18.811686 31981 server_base.cc:1034] running on GCE node
I20260806 13:02:18.811998 31981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:18.812314 31981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:18.813504 31981 hybrid_clock.cc:648] HybridClock initialized: now 1786021338813497 us; error 43 us; skew 500 ppm
Aug 06 13:02:18 dist-test-slave-srgv krb5kdc[31872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021338, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:02:18.816834 31981 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:02:18.817466 31981 webserver.cc:460] Webserver started at http://127.20.245.129:42433/ using document root <none> and password file <none>
I20260806 13:02:18.817788 31981 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:18.817866 31981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:18.818049 31981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:18.819552 31981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "69516ad3313243fdb37cd89155020276"
format_stamp: "Formatted at 2026-08-06 13:02:18 on dist-test-slave-srgv"
server_key: "a8a2c74470dca57ff355973677466c7f"
server_key_iv: "a9b7c59909bb2a8fd89b68bf90d2c77c"
server_key_version: "encryptionkey@0"
I20260806 13:02:18.820056 31981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "69516ad3313243fdb37cd89155020276"
format_stamp: "Formatted at 2026-08-06 13:02:18 on dist-test-slave-srgv"
server_key: "a8a2c74470dca57ff355973677466c7f"
server_key_iv: "a9b7c59909bb2a8fd89b68bf90d2c77c"
server_key_version: "encryptionkey@0"
I20260806 13:02:18.822000 31981 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:02:18.823606 31996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:18.823936 31981 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260806 13:02:18.824074 31981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "69516ad3313243fdb37cd89155020276"
format_stamp: "Formatted at 2026-08-06 13:02:18 on dist-test-slave-srgv"
server_key: "a8a2c74470dca57ff355973677466c7f"
server_key_iv: "a9b7c59909bb2a8fd89b68bf90d2c77c"
server_key_version: "encryptionkey@0"
I20260806 13:02:18.824266 31981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:18.843111 31981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:18.846067 31981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:18.846271 31981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:18.846580 31981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:18.846976 31981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:18.847033 31981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:18.847090 31981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:18.847121 31981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:18.854370 31981 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:39885
I20260806 13:02:18.854419 32111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:39885 every 8 connection(s)
I20260806 13:02:18.854887 31981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:02:18.858067 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 31981
I20260806 13:02:18.858199 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:02:18.858460 21462 external_mini_cluster.cc:1428] Setting key 8288ed6e5af68f55d97fbd1c5d6c4655
Aug 06 13:02:18 dist-test-slave-srgv krb5kdc[31872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021338, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:02:18.867985 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:18.855966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:52197 (local address 127.20.245.190:46107)
0806 13:02:18.856061 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:18.856064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:18.856295 (+ 231us) server_negotiation.cc:407] Connection header received
0806 13:02:18.856894 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:18.856895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:18.856912 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:18.856985 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:18.858393 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:18.859274 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:18.860507 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:18.860771 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:18.860859 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:18.863938 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:18.863941 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:18.863942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:02:18.863953 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:18.865689 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:18.866344 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:18.866347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:18.866348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:18.866449 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:18.866796 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:18.866798 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:18.866798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:18.866958 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:18.867039 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:18.867555 (+ 516us) server_negotiation.cc:299] Negotiation successful
0806 13:02:18.867798 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 13:02:18.868170 32114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:18.855880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46107 (local address 127.20.245.129:52197)
0806 13:02:18.856088 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:18.856144 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:18.856774 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:18.857079 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:18.857084 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:18.857855 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:18.858228 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:18.858238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:18.859394 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:18.859395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:18.860394 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:18.860397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:18.860875 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:18.860877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:18.861039 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:18.861761 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:18.861773 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:18.863753 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:18.865827 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:02:18.865845 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:02:18.865849 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:02:18.866197 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:02:18.866539 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:02:18.866540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:02:18.866541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:02:18.866722 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:02:18.867037 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:18.867049 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:18.867314 (+ 265us) client_negotiation.cc:769] Sending connection context
0806 13:02:18.867504 (+ 190us) client_negotiation.cc:240] Negotiation successful
0806 13:02:18.867792 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:02:18.869083 32112 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46107
I20260806 13:02:18.869207 32112 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:18.869515 32112 heartbeater.cc:511] Master 127.20.245.190:46107 requested a full tablet report, sending...
I20260806 13:02:18.870307 31918 ts_manager.cc:194] Registered new tserver with Master: 69516ad3313243fdb37cd89155020276 (127.20.245.129:39885)
I20260806 13:02:18.871145 31918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:52197
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:02:18.891016 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46107
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:02:18.995389 32117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:18.995714 32117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:18.995761 32117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:18.997234 32117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:18.997328 32117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:18.997380 32117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:02:18.999303 32117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:18.999678 32117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:18.999984 32117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:19.006285 32123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:19.006285 32125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:19.006290 32122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:19.006814 32117 server_base.cc:1034] running on GCE node
I20260806 13:02:19.007093 32117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:19.007442 32117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:19.008634 32117 hybrid_clock.cc:648] HybridClock initialized: now 1786021339008613 us; error 43 us; skew 500 ppm
Aug 06 13:02:19 dist-test-slave-srgv krb5kdc[31872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:02:19.011966 32117 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:02:19.012526 32117 webserver.cc:460] Webserver started at http://127.20.245.130:37523/ using document root <none> and password file <none>
I20260806 13:02:19.012777 32117 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:19.012827 32117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:19.012953 32117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:19.014287 32117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "e77d9c4a301543338dbb6138e5251269"
format_stamp: "Formatted at 2026-08-06 13:02:19 on dist-test-slave-srgv"
server_key: "ac5f875b444462c6b45bed008ae6217b"
server_key_iv: "6f22023ee5e0607cecacebeb4365d030"
server_key_version: "encryptionkey@0"
I20260806 13:02:19.014688 32117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "e77d9c4a301543338dbb6138e5251269"
format_stamp: "Formatted at 2026-08-06 13:02:19 on dist-test-slave-srgv"
server_key: "ac5f875b444462c6b45bed008ae6217b"
server_key_iv: "6f22023ee5e0607cecacebeb4365d030"
server_key_version: "encryptionkey@0"
I20260806 13:02:19.016434 32117 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 13:02:19.017408 32132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:19.017642 32117 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:19.017746 32117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "e77d9c4a301543338dbb6138e5251269"
format_stamp: "Formatted at 2026-08-06 13:02:19 on dist-test-slave-srgv"
server_key: "ac5f875b444462c6b45bed008ae6217b"
server_key_iv: "6f22023ee5e0607cecacebeb4365d030"
server_key_version: "encryptionkey@0"
I20260806 13:02:19.017871 32117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:19.059409 32117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:19.062436 32117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:19.062601 32117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:19.062880 32117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:19.063401 32117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:19.063449 32117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:19.063498 32117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:19.063530 32117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:19.071574 32117 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:35175
I20260806 13:02:19.071622 32246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:35175 every 8 connection(s)
I20260806 13:02:19.072106 32117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:02:19.079265 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 32117
I20260806 13:02:19.079409 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:02:19.079653 21462 external_mini_cluster.cc:1428] Setting key 8675ad716e6e48ec9e71c72aa0cc0b51
Aug 06 13:02:19 dist-test-slave-srgv krb5kdc[31872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:02:19.084445 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.073129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:41293 (local address 127.20.245.190:46107)
0806 13:02:19.073204 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.073207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.073486 (+ 279us) server_negotiation.cc:407] Connection header received
0806 13:02:19.074184 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.074185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.074202 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.074277 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:19.075504 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.076175 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.077248 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.077470 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.077535 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.080670 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:19.080672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:19.080673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:02:19.080682 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:19.082660 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:19.083130 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:19.083132 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:19.083132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:19.083269 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:19.083577 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:19.083579 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:19.083579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:19.083775 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:19.083856 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.084160 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.084271 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 13:02:19.084574 32249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.073109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46107 (local address 127.20.245.130:41293)
0806 13:02:19.073306 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:19.073351 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:19.074028 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:19.074403 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:19.074407 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:19.075115 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:19.075407 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.075413 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.076272 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.076273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.077167 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.077170 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.077616 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.077617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.077759 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.078519 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:19.078530 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:19.080517 (+ 1987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:19.082778 (+ 2261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:02:19.082786 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:02:19.082788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:02:19.083055 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:02:19.083355 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:02:19.083356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:02:19.083357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:02:19.083513 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:02:19.083847 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:19.083852 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:19.084011 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 13:02:19.084153 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 13:02:19.084319 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":113,"threads_started":1}
I20260806 13:02:19.085187 32247 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46107
I20260806 13:02:19.085331 32247 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:19.085603 32247 heartbeater.cc:511] Master 127.20.245.190:46107 requested a full tablet report, sending...
I20260806 13:02:19.086218 31918 ts_manager.cc:194] Registered new tserver with Master: e77d9c4a301543338dbb6138e5251269 (127.20.245.130:35175)
I20260806 13:02:19.086683 31918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:41293
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:02:19.115885 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46107
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:02:19.216622 32252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:02:19.216952 32252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:02:19.217000 32252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:02:19.218449 32252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:02:19.218524 32252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:02:19.218577 32252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:02:19.220435 32252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:02:19.220789 32252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:02:19.221082 32252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:02:19.227545 32261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:19.227566 32259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:02:19.227545 32257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:02:19.227957 32252 server_base.cc:1034] running on GCE node
I20260806 13:02:19.228268 32252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:02:19.228681 32252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:02:19.229928 32252 hybrid_clock.cc:648] HybridClock initialized: now 1786021339229912 us; error 39 us; skew 500 ppm
Aug 06 13:02:19 dist-test-slave-srgv krb5kdc[31872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:02:19.233417 32252 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:02:19.234170 32252 webserver.cc:460] Webserver started at http://127.20.245.131:43817/ using document root <none> and password file <none>
I20260806 13:02:19.234510 32252 fs_manager.cc:359] Metadata directory not provided
I20260806 13:02:19.234568 32252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:02:19.234747 32252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:02:19.236290 32252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "6e474f7aae0c495f9a6eae2f0140e014"
format_stamp: "Formatted at 2026-08-06 13:02:19 on dist-test-slave-srgv"
server_key: "97865126c35be01766b8c2cd69d2dd5f"
server_key_iv: "c137605aa1b2628e3458c3222a1a5281"
server_key_version: "encryptionkey@0"
I20260806 13:02:19.236744 32252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "6e474f7aae0c495f9a6eae2f0140e014"
format_stamp: "Formatted at 2026-08-06 13:02:19 on dist-test-slave-srgv"
server_key: "97865126c35be01766b8c2cd69d2dd5f"
server_key_iv: "c137605aa1b2628e3458c3222a1a5281"
server_key_version: "encryptionkey@0"
I20260806 13:02:19.238526 32252 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 13:02:19.239542 32268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:19.239776 32252 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:02:19.239914 32252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "6e474f7aae0c495f9a6eae2f0140e014"
format_stamp: "Formatted at 2026-08-06 13:02:19 on dist-test-slave-srgv"
server_key: "97865126c35be01766b8c2cd69d2dd5f"
server_key_iv: "c137605aa1b2628e3458c3222a1a5281"
server_key_version: "encryptionkey@0"
I20260806 13:02:19.240012 32252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:02:19.263717 32252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:02:19.266552 32252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:02:19.266773 32252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:02:19.267093 32252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:02:19.267531 32252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:02:19.267590 32252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:19.267638 32252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:02:19.267688 32252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:02:19.274861 32252 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:44297
I20260806 13:02:19.274893 32382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:44297 every 8 connection(s)
I20260806 13:02:19.275380 32252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
Aug 06 13:02:19 dist-test-slave-srgv krb5kdc[31872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021339, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:02:19.283419 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 32252
I20260806 13:02:19.283546 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:02:19.283782 21462 external_mini_cluster.cc:1428] Setting key bdac7b0ce971ca3d4c92e8e743f8f775
I20260806 13:02:19.286360 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.276329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:58001 (local address 127.20.245.190:46107)
0806 13:02:19.276408 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.276424 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.276648 (+ 224us) server_negotiation.cc:407] Connection header received
0806 13:02:19.277307 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.277308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.277326 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.277380 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:19.278501 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.279086 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.280223 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.280450 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.280533 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.283076 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:19.283079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:19.283079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:02:19.283089 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:19.284897 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:19.285355 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:19.285356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:19.285357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:19.285425 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:19.285670 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:19.285671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:19.285671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:19.285822 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:19.285895 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.286192 (+ 297us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.286277 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:02:19.286549 32385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.276286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46107 (local address 127.20.245.131:58001)
0806 13:02:19.276503 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:19.276548 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:19.277181 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:19.277479 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:19.277484 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:19.278147 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:02:19.278389 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.278394 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.279235 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.279236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.280114 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.280117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.280539 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.280540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.280681 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.281287 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:02:19.281297 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:02:19.282948 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:02:19.284985 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:02:19.284993 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:02:19.284995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:02:19.285272 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:02:19.285482 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:02:19.285482 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:02:19.285483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:02:19.285585 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:02:19.285891 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:02:19.285896 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:02:19.286046 (+ 150us) client_negotiation.cc:769] Sending connection context
0806 13:02:19.286139 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 13:02:19.286298 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":104,"threads_started":1}
I20260806 13:02:19.287392 32383 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46107
I20260806 13:02:19.287523 32383 heartbeater.cc:464] Registering TS with master...
I20260806 13:02:19.287740 32383 heartbeater.cc:511] Master 127.20.245.190:46107 requested a full tablet report, sending...
I20260806 13:02:19.288216 31918 ts_manager.cc:194] Registered new tserver with Master: 6e474f7aae0c495f9a6eae2f0140e014 (127.20.245.131:44297)
I20260806 13:02:19.288650 31918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:58001
I20260806 13:02:19.296231 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:02:19.305418 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.298053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52856 (local address 127.20.245.190:46107)
0806 13:02:19.298125 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.298128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.298312 (+ 184us) server_negotiation.cc:407] Connection header received
0806 13:02:19.298384 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.298385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.298398 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.298451 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:02:19.299141 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.299772 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.300665 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.300874 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.300924 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.302459 (+ 1535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:02:19.302460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:02:19.302461 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:02:19.302469 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:02:19.304113 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:19.304517 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:19.304518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:19.304519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:19.304577 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:02:19.304774 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:02:19.304775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:02:19.304775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:02:19.304968 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:02:19.305058 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.305223 (+ 165us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.305304 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 13:02:19.307636 31918 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:02:19.309767 31918 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:02:19.317481 32398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.313009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:44297 (local address 127.0.0.1:38910)
0806 13:02:19.313773 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:19.313782 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:19.313862 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:19.314105 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:19.314106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:19.314108 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:02:19.314156 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.314157 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.315445 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.315446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.316267 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.316270 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.317068 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.317070 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.317174 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.317191 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 13:02:19.317287 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 13:02:19.317360 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"mutex_wait_us":1,"thread_start_us":96,"threads_started":1}
I20260806 13:02:19.317653 32395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.312775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:35175 (local address 127.0.0.1:59752)
0806 13:02:19.313146 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:19.313159 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:19.313230 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:19.313741 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:19.313742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:19.313743 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:02:19.313800 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.313801 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.314875 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.314876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.316297 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.316300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.317387 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.317388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.317452 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.317456 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:02:19.317524 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 13:02:19.317577 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":64,"threads_started":1}
I20260806 13:02:19.317687 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.313207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59752 (local address 127.20.245.130:35175)
0806 13:02:19.313477 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.313481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.313491 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:02:19.313537 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.313538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.313552 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.313647 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:02:19.313883 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.314768 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.316411 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.317188 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.317276 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.317328 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.317546 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.317598 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":119,"threads_started":1}
I20260806 13:02:19.317847 32399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.313164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38910 (local address 127.20.245.131:44297)
0806 13:02:19.313405 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.313412 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.313929 (+ 517us) server_negotiation.cc:407] Connection header received
0806 13:02:19.313982 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.313985 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.314002 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.314091 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:02:19.314227 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.315336 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.316373 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.316968 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.317060 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.317133 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.317649 (+ 516us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.317721 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":114,"threads_started":1}
I20260806 13:02:19.317487 32396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.312767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39885 (local address 127.0.0.1:38752)
0806 13:02:19.313006 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:19.313062 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:19.313152 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:19.313651 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:19.313655 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:19.313658 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:02:19.313761 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.313763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.315222 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.315223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.316299 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.316301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.317273 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.317274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.317335 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.317338 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:02:19.317392 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 13:02:19.317433 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":156,"threads_started":1}
I20260806 13:02:19.318233 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.312938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38752 (local address 127.20.245.129:39885)
0806 13:02:19.313448 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.313454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.313466 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:02:19.313516 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.313519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.313538 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.313637 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:02:19.313863 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.315069 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.316410 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.317182 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.317271 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.317328 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.318077 (+ 749us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.318133 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":96,"threads_started":1}
I20260806 13:02:19.318845 32045 tablet_service.cc:1467] Processing CreateTablet for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b (DEFAULT_TABLE table=test-table [id=afc1e4b619a344709e5befdf324a4644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:02:19.318794 32316 tablet_service.cc:1467] Processing CreateTablet for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b (DEFAULT_TABLE table=test-table [id=afc1e4b619a344709e5befdf324a4644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:02:19.318792 32181 tablet_service.cc:1467] Processing CreateTablet for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b (DEFAULT_TABLE table=test-table [id=afc1e4b619a344709e5befdf324a4644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:02:19.319228 32181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:02:19.319228 32316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:02:19.319243 32045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:02:19.322907 32401 tablet_bootstrap.cc:492] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276: Bootstrap starting.
I20260806 13:02:19.323539 32402 tablet_bootstrap.cc:492] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: Bootstrap starting.
I20260806 13:02:19.323899 32401 tablet_bootstrap.cc:654] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276: Neither blocks nor log segments found. Creating new log.
I20260806 13:02:19.324218 32402 tablet_bootstrap.cc:654] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: Neither blocks nor log segments found. Creating new log.
I20260806 13:02:19.324565 32401 log.cc:824] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276: Log is configured to *not* fsync() on all Append() calls
I20260806 13:02:19.324837 32402 log.cc:824] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: Log is configured to *not* fsync() on all Append() calls
I20260806 13:02:19.325260 32403 tablet_bootstrap.cc:492] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: Bootstrap starting.
I20260806 13:02:19.325692 32402 tablet_bootstrap.cc:492] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: No bootstrap required, opened a new log
I20260806 13:02:19.325758 32402 ts_tablet_manager.cc:1397] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:02:19.325781 32401 tablet_bootstrap.cc:492] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276: No bootstrap required, opened a new log
I20260806 13:02:19.325986 32401 ts_tablet_manager.cc:1397] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:02:19.326098 32403 tablet_bootstrap.cc:654] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: Neither blocks nor log segments found. Creating new log.
I20260806 13:02:19.326766 32403 log.cc:824] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: Log is configured to *not* fsync() on all Append() calls
I20260806 13:02:19.327672 32403 tablet_bootstrap.cc:492] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: No bootstrap required, opened a new log
I20260806 13:02:19.327764 32403 ts_tablet_manager.cc:1397] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:02:19.328171 32402 raft_consensus.cc:348] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.328393 32402 raft_consensus.cc:374] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:02:19.328446 32402 raft_consensus.cc:729] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e77d9c4a301543338dbb6138e5251269, State: Initialized, Role: FOLLOWER
I20260806 13:02:19.328617 32402 consensus_queue.cc:260] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.328994 32402 ts_tablet_manager.cc:1428] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:02:19.329170 32247 heartbeater.cc:503] Master 127.20.245.190:46107 was elected leader, sending a full tablet report...
I20260806 13:02:19.329322 32401 raft_consensus.cc:348] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.329566 32401 raft_consensus.cc:374] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:02:19.329653 32401 raft_consensus.cc:729] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69516ad3313243fdb37cd89155020276, State: Initialized, Role: FOLLOWER
I20260806 13:02:19.329882 32401 consensus_queue.cc:260] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.330119 32403 raft_consensus.cc:348] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.330222 32401 ts_tablet_manager.cc:1428] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260806 13:02:19.330283 32403 raft_consensus.cc:374] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:02:19.330317 32403 raft_consensus.cc:729] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e474f7aae0c495f9a6eae2f0140e014, State: Initialized, Role: FOLLOWER
I20260806 13:02:19.330374 32112 heartbeater.cc:503] Master 127.20.245.190:46107 was elected leader, sending a full tablet report...
I20260806 13:02:19.330442 32403 consensus_queue.cc:260] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.330762 32403 ts_tablet_manager.cc:1428] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:02:19.330825 32383 heartbeater.cc:503] Master 127.20.245.190:46107 was elected leader, sending a full tablet report...
W20260806 13:02:19.355996 32113 tablet.cc:2369] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:02:19.407778 32408 raft_consensus.cc:482] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:02:19.407940 32408 raft_consensus.cc:504] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.408458 32408 leader_election.cc:288] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e77d9c4a301543338dbb6138e5251269 (127.20.245.130:35175), 6e474f7aae0c495f9a6eae2f0140e014 (127.20.245.131:44297)
I20260806 13:02:19.412200 32399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.409084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:50433 (local address 127.20.245.131:44297)
0806 13:02:19.409145 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.409147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.409269 (+ 122us) server_negotiation.cc:407] Connection header received
0806 13:02:19.409320 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.409322 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.409334 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.409407 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:02:19.409598 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.410107 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.411362 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.411798 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.411890 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.411902 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.412054 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.412103 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 13:02:19.412200 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.408872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:39467 (local address 127.20.245.130:35175)
0806 13:02:19.408951 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.408953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.409010 (+ 57us) server_negotiation.cc:407] Connection header received
0806 13:02:19.409117 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.409118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.409130 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.409202 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:02:19.409439 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.410037 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.411365 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.411796 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.411889 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.411902 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.412062 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.412110 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:02:19.412221 32411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.408979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:44297 (local address 127.20.245.129:50433)
0806 13:02:19.409182 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:19.409192 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:19.409253 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:19.409433 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:19.409434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:19.409435 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:02:19.409511 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.409513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.410195 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.410195 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.411250 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.411258 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.411889 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.411890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.411972 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.411977 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:02:19.412047 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 13:02:19.412102 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":23,"thread_start_us":149,"threads_started":1}
I20260806 13:02:19.412227 32410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.408730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:35175 (local address 127.20.245.129:39467)
0806 13:02:19.408888 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:19.408916 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 13:02:19.409035 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:02:19.409211 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:02:19.409212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:02:19.409215 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:02:19.409354 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.409357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.410145 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.410146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.411253 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:02:19.411256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.411891 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.411892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:02:19.411973 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.411977 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:02:19.412041 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 13:02:19.412103 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":79,"thread_start_us":102,"threads_started":1}
I20260806 13:02:19.412782 32201 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc201d36a08d40a1ab1aa4f0c1ca7f2b" candidate_uuid: "69516ad3313243fdb37cd89155020276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e77d9c4a301543338dbb6138e5251269" is_pre_election: true
I20260806 13:02:19.412781 32336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc201d36a08d40a1ab1aa4f0c1ca7f2b" candidate_uuid: "69516ad3313243fdb37cd89155020276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e474f7aae0c495f9a6eae2f0140e014" is_pre_election: true
I20260806 13:02:19.412992 32201 raft_consensus.cc:2454] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69516ad3313243fdb37cd89155020276 in term 0.
I20260806 13:02:19.412992 32336 raft_consensus.cc:2454] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69516ad3313243fdb37cd89155020276 in term 0.
I20260806 13:02:19.413323 31998 leader_election.cc:302] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69516ad3313243fdb37cd89155020276, e77d9c4a301543338dbb6138e5251269; no voters:
I20260806 13:02:19.413497 32408 raft_consensus.cc:2781] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:02:19.413581 32408 raft_consensus.cc:482] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:02:19.413615 32408 raft_consensus.cc:3037] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:02:19.414585 32408 raft_consensus.cc:504] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.414772 32408 leader_election.cc:288] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [CANDIDATE]: Term 1 election: Requested vote from peers e77d9c4a301543338dbb6138e5251269 (127.20.245.130:35175), 6e474f7aae0c495f9a6eae2f0140e014 (127.20.245.131:44297)
I20260806 13:02:19.414997 32201 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc201d36a08d40a1ab1aa4f0c1ca7f2b" candidate_uuid: "69516ad3313243fdb37cd89155020276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e77d9c4a301543338dbb6138e5251269"
I20260806 13:02:19.415009 32336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc201d36a08d40a1ab1aa4f0c1ca7f2b" candidate_uuid: "69516ad3313243fdb37cd89155020276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e474f7aae0c495f9a6eae2f0140e014"
I20260806 13:02:19.415110 32201 raft_consensus.cc:3037] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:02:19.415107 32336 raft_consensus.cc:3037] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:02:19.416097 32201 raft_consensus.cc:2454] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69516ad3313243fdb37cd89155020276 in term 1.
I20260806 13:02:19.416109 32336 raft_consensus.cc:2454] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69516ad3313243fdb37cd89155020276 in term 1.
I20260806 13:02:19.416290 31998 leader_election.cc:302] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69516ad3313243fdb37cd89155020276, e77d9c4a301543338dbb6138e5251269; no voters:
I20260806 13:02:19.416416 32408 raft_consensus.cc:2781] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:02:19.416669 32408 raft_consensus.cc:686] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [term 1 LEADER]: Becoming Leader. State: Replica: 69516ad3313243fdb37cd89155020276, State: Running, Role: LEADER
I20260806 13:02:19.416801 32408 consensus_queue.cc:237] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } }
I20260806 13:02:19.417997 31916 catalog_manager.cc:5495] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69516ad3313243fdb37cd89155020276 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "69516ad3313243fdb37cd89155020276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69516ad3313243fdb37cd89155020276" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 } health_report { overall_health: UNKNOWN } } }
I20260806 13:02:19.443296 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.440217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38754 (local address 127.20.245.129:39885)
0806 13:02:19.440308 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0806 13:02:19.440311 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:02:19.440320 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:02:19.440371 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:02:19.440372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:02:19.440398 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:02:19.440476 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:02:19.440630 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.441151 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.442166 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:02:19.442427 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:02:19.442504 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:02:19.442770 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:02:19.442921 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:02:19.443012 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 13:02:19.443091 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 13:02:19.443123 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 13:02:19.445987 32201 raft_consensus.cc:1261] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 1 FOLLOWER]: Refusing update from remote peer 69516ad3313243fdb37cd89155020276: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:02:19.445987 32336 raft_consensus.cc:1261] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 1 FOLLOWER]: Refusing update from remote peer 69516ad3313243fdb37cd89155020276: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:02:19.446497 32408 consensus_queue.cc:1035] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e474f7aae0c495f9a6eae2f0140e014" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:02:19.446684 32412 consensus_queue.cc:1035] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e77d9c4a301543338dbb6138e5251269" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:02:19.450773 32417 mvcc.cc:205] Tried to move back new op lower bound from 7315543406367006720 to 7315543406252179456. Current Snapshot: MvccSnapshot[applied={T|T < 7315543406367006720}]
I20260806 13:02:19.451484 32418 mvcc.cc:205] Tried to move back new op lower bound from 7315543406367006720 to 7315543406252179456. Current Snapshot: MvccSnapshot[applied={T|T < 7315543406367006720}]
I20260806 13:02:19.452817 31916 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:02:19.452968 31916 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:02:19.453958 31916 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 11069b1a1beb4bb2bc0217eba37f0d75: Sending DeleteTablet for 3 replicas of tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b
I20260806 13:02:19.454449 32045 tablet_service.cc:1514] Processing DeleteTablet for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:02:19 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:38752
I20260806 13:02:19.454463 32316 tablet_service.cc:1514] Processing DeleteTablet for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:02:19 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:38910
I20260806 13:02:19.454502 32181 tablet_service.cc:1514] Processing DeleteTablet for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:02:19 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:59752
I20260806 13:02:19.454871 32427 tablet_replica.cc:330] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: stopping tablet replica
I20260806 13:02:19.455031 32428 tablet_replica.cc:330] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 69516ad3313243fdb37cd89155020276: stopping tablet replica
I20260806 13:02:19.455305 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 31981
I20260806 13:02:19.456881 32427 raft_consensus.cc:2229] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:02:19.457120 32427 raft_consensus.cc:2258] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:02:19.457909 32427 ts_tablet_manager.cc:1905] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:02:19.459862 32427 ts_tablet_manager.cc:1918] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:02:19.459947 32427 log.cc:1196] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/bc201d36a08d40a1ab1aa4f0c1ca7f2b
I20260806 13:02:19.460340 32427 ts_tablet_manager.cc:1939] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P e77d9c4a301543338dbb6138e5251269: Deleting consensus metadata
I20260806 13:02:19.460937 31903 catalog_manager.cc:4841] TS e77d9c4a301543338dbb6138e5251269 (127.20.245.130:35175): tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b (table test-table [id=afc1e4b619a344709e5befdf324a4644]) successfully deleted
W20260806 13:02:19.463020 31905 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:39885 (error 108)
I20260806 13:02:19.463099 32429 tablet_replica.cc:330] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: stopping tablet replica
I20260806 13:02:19.463308 32429 raft_consensus.cc:2229] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:02:19.463371 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 32117
I20260806 13:02:19.463493 32429 raft_consensus.cc:2258] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:02:19.465031 32396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:02:19.464843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39885 (local address 127.0.0.1:38762)
0806 13:02:19.464917 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 13:02:19.464972 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:39885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 13:02:19.465268 31905 catalog_manager.cc:4584] TS 69516ad3313243fdb37cd89155020276 (127.20.245.129:39885): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b: Network error: Client connection negotiation failed: client connection to 127.20.245.129:39885: connect: Connection refused (error 111)
I20260806 13:02:19.466117 32429 ts_tablet_manager.cc:1905] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:02:19.467852 32429 ts_tablet_manager.cc:1918] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:02:19.467963 32429 log.cc:1196] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/bc201d36a08d40a1ab1aa4f0c1ca7f2b
I20260806 13:02:19.468276 32429 ts_tablet_manager.cc:1939] T bc201d36a08d40a1ab1aa4f0c1ca7f2b P 6e474f7aae0c495f9a6eae2f0140e014: Deleting consensus metadata
I20260806 13:02:19.468844 31903 catalog_manager.cc:4841] TS 6e474f7aae0c495f9a6eae2f0140e014 (127.20.245.131:44297): tablet bc201d36a08d40a1ab1aa4f0c1ca7f2b (table test-table [id=afc1e4b619a344709e5befdf324a4644]) successfully deleted
I20260806 13:02:19.471064 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 32252
I20260806 13:02:19.476871 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 31886
2026-08-06T13:02:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2259 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:02:19 dist-test-slave-srgv krb5kdc[32433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:02:19 dist-test-slave-srgv krb5kdc[32433](info): set up 2 sockets
Aug 06 13:02:19 dist-test-slave-srgv krb5kdc[32433](info): commencing operation
krb5kdc: starting...
W20260806 13:02:20.577685 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:02:20 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:02:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:02:20Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.245.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.245.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/rangeradmin_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/rangeradmin_127.20.245.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.245.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.245.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/rangerlookup_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/rangerlookup_127.20.245.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.245.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.245.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/HTTP_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/HTTP_127.20.245.148@KRBTEST.COM.keytab.
I20260806 13:02:20.778081 21462 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskGJGA6C/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/postgres -l logfile start
2026-08-06 13:02:23.834 UTC [32463] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 13:02:23.834 UTC [32463] LOG: listening on IPv4 address "127.20.245.148", port 43173
2026-08-06 13:02:23.839 UTC [32463] LOG: listening on Unix socket "/tmp/.s.PGSQL.43173"
2026-08-06 13:02:23.865 UTC [32466] LOG: database system was shut down at 2026-08-06 13:02:22 UTC
2026-08-06 13:02:23.870 UTC [32463] LOG: database system is ready to accept connections
I20260806 13:02:24.865782 21462 mini_postgres.cc:96] Postgres bound to 43173
2026-08-06 13:02:24.875 UTC [32474] FATAL: database "slave" does not exist
127.20.245.148:43173 - accepting connections
I20260806 13:02:24.876573 21462 mini_ranger.cc:161] Starting Ranger...
I20260806 13:02:24.897039 21462 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 13:02:25.516489 21462 mini_ranger.cc:87] Created ranger Postgres database
I20260806 13:02:25.516590 21462 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-admin
2026-08-06 13:02:25,895 [I] DB FLAVOR :POSTGRES
2026-08-06 13:02:25,896 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 13:02:25,896 [I] Checking connection..
2026-08-06 13:02:25,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 13:02:26,217 [I] Checking connection passed.
2026-08-06 13:02:26,218 [I] --------- Verifying version history table ---------
2026-08-06 13:02:26,218 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 13:02:26,527 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 13:02:26,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 13:02:26,831 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 13:02:26,831 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 13:02:26,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 13:02:27.129 UTC [32539] WARNING: there is no transaction in progress
2026-08-06 13:02:27,137 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 13:02:27,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 13:02:27,430 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 13:02:27,430 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 13:02:27,430 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 13:02:27,716 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 13:02:28,003 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-srgv.c.gcp-upstream.internal','N') ;"
2026-08-06 13:02:28,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 13:02:28,604 [I] Table x_portal_user does not exist in database ranger
2026-08-06 13:02:28,604 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 13:02:28,883 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 13:02:28,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 13:02:29,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 13:02:29,443 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 13:02:29,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 13:02:30.653 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.674 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.695 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.714 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.732 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.753 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.821 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.830 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.847 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.860 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.874 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.893 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.905 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.913 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.923 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:30.933 UTC [32649] WARNING: there is no transaction in progress
2026-08-06 13:02:31,812 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 13:02:31,812 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 13:02:32,096 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 13:02:32,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 13:02:32,402 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 13:02:32,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 13:02:32,717 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 13:02:32,718 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 13:02:33,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 13:02:33,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-srgv.c.gcp-upstream.internal';"
2026-08-06 13:02:33,616 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 13:02:33,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 13:02:33,907 [I] DB_PATCHES have already been applied
I20260806 13:02:33.914602 21462 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-admin:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskGJGA6C/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 13:02:33.914737 21462 mini_ranger.cc:193] Using host: 127.20.245.148
I20260806 13:02:33.919551 21462 mini_ranger.cc:227] Ranger admin URL: http://127.20.245.148:45159
Aug 06, 2026 1:02:34 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 1:02:34 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 1:02:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 1:02:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 1:02:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 1:02:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 1:02:35 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 13:02:36.361724 21462 mini_ranger.cc:160] Time spent starting Ranger: real 11.485s user 0.007s sys 0.008s
Aug 06, 2026 1:03:02 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 1:03:02 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 06, 2026 1:03:02 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 1:03:02 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 1:03:03 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 13:03:04.259943 21462 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.245.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.245.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/rangerkms_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/rangerkms_127.20.245.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.245.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.245.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.245.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/HTTP_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.245.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/HTTP_127.20.245.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 13:03:04 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021384, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 13:03:04.368644 21462 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 13:03:04.383565 21462 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 13:03:05.529276 21462 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 13:03:05.529382 21462 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms
I20260806 13:03:05.529395 21462 mini_ranger_kms.cc:227] Using postgres at 127.20.245.148:43173
2026-08-06 13:03:06,792 [I] DB FLAVOR :POSTGRES
2026-08-06 13:03:06,793 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 13:03:06,793 [I] Checking connection
2026-08-06 13:03:06,793 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 13:03:07,205 [I] connection success
2026-08-06 13:03:07,205 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 13:03:07,205 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 13:03:07,205 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 13:03:07,503 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 13:03:07,504 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 13:03:07,504 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 13:03:07,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:43173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 13:03:07,848 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 13:03:08.626672 21462 mini_ranger_kms.cc:310] Created kms service
I20260806 13:03:08.981041 21462 mini_ranger_kms.cc:326] Created kudu user
I20260806 13:03:09.078469 21462 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 13:03:09 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021384, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:03:09.811604 21462 mini_ranger_kms.cc:384] Added ranger policy
I20260806 13:03:09.811925 21462 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms:/tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 13:03:09.812052 21462 mini_ranger_kms.cc:240] Using host: 127.20.245.148
I20260806 13:03:09.817600 21462 mini_ranger_kms.cc:276] Ranger KMS PID: 365
I20260806 13:03:09.817803 21462 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.245.148:35789
Aug 06, 2026 1:03:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 1:03:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 1:03:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 1:03:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 1:03:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 1:03:12 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 13:03:12.387497 21462 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 8.019s user 0.008s sys 0.845s
I20260806 13:03:12.387696 21462 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 13:03:12.387856 21462 mini_ranger_kms.cc:401] 127.20.245.148:35789/kms/v1/keys
Aug 06 13:03:13 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786021393, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.245.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 13:03:13 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021393, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.245.148@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
Aug 06 13:03:14 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021393, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.245.148@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
Aug 06 13:03:17 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:03:18.043875 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:39087
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:39087
--ranger_config_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35789/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:03:18.214780 417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:03:18.215132 417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:03:18.215183 417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:03:18.217811 417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:03:18.217964 417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:03:18.217993 417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:03:18.218016 417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:03:18.218050 417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:03:18.220844 417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.245.148:35789/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:39087
--ranger_config_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:39087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:03:18.221261 417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:03:18.221581 417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:03:18.230125 425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:03:18.230414 417 server_base.cc:1034] running on GCE node
W20260806 13:03:18.230178 423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:03:18.230201 422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:03:18.231216 417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:03:18.231671 417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:03:18.232863 417 hybrid_clock.cc:648] HybridClock initialized: now 1786021398232837 us; error 53 us; skew 500 ppm
Aug 06 13:03:18 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021398, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:03:18.237464 417 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:03:18.238171 417 webserver.cc:460] Webserver started at http://127.20.245.190:34265/ using document root <none> and password file <none>
I20260806 13:03:18.238480 417 fs_manager.cc:359] Metadata directory not provided
I20260806 13:03:18.238556 417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:03:18.238741 417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 13:03:18 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021398, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:03:18.334069 417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "fa63128880f449f789c35d81e6b646d8"
format_stamp: "Formatted at 2026-08-06 13:03:18 on dist-test-slave-srgv"
server_key: "09d75d165a3575bffbb8527c5104bf4d"
server_key_iv: "f9949f88ab735ba2e98ac9706f4dfe69"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:18.334689 417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "fa63128880f449f789c35d81e6b646d8"
format_stamp: "Formatted at 2026-08-06 13:03:18 on dist-test-slave-srgv"
server_key: "09d75d165a3575bffbb8527c5104bf4d"
server_key_iv: "f9949f88ab735ba2e98ac9706f4dfe69"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:18.337265 417 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.001s
I20260806 13:03:18.358596 433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:18.358954 417 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:03:18.359118 417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "fa63128880f449f789c35d81e6b646d8"
format_stamp: "Formatted at 2026-08-06 13:03:18 on dist-test-slave-srgv"
server_key: "09d75d165a3575bffbb8527c5104bf4d"
server_key_iv: "f9949f88ab735ba2e98ac9706f4dfe69"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:18.359313 417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:03:18.376865 417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:03:18.379668 417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:03:18.379949 417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:03:18.393270 417 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:39087
I20260806 13:03:18.393359 485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:39087 every 8 connection(s)
I20260806 13:03:18.393963 417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:03:18.395576 486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:03:18.397440 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 417
I20260806 13:03:18.397652 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:03:18.397907 21462 external_mini_cluster.cc:1428] Setting key 23fd773c701f5f95d19278567b2e9567
I20260806 13:03:18.401556 486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8: Bootstrap starting.
I20260806 13:03:18.403271 486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8: Neither blocks nor log segments found. Creating new log.
I20260806 13:03:18.404186 486 log.cc:824] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8: Log is configured to *not* fsync() on all Append() calls
I20260806 13:03:18.405328 486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8: No bootstrap required, opened a new log
Aug 06 13:03:18 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:03:18.410138 486 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa63128880f449f789c35d81e6b646d8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39087 } }
I20260806 13:03:18.410444 486 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:03:18.410513 486 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa63128880f449f789c35d81e6b646d8, State: Initialized, Role: FOLLOWER
I20260806 13:03:18.410774 486 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa63128880f449f789c35d81e6b646d8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39087 } }
I20260806 13:03:18.410907 486 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:03:18.410967 486 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:03:18.411041 486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:03:18.412210 486 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa63128880f449f789c35d81e6b646d8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39087 } }
I20260806 13:03:18.412393 486 leader_election.cc:302] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa63128880f449f789c35d81e6b646d8; no voters:
I20260806 13:03:18.412668 486 leader_election.cc:288] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:03:18.412737 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:18.398740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38046 (local address 127.20.245.190:39087)
0806 13:03:18.399068 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:18.399082 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:18.399238 (+ 156us) server_negotiation.cc:407] Connection header received
0806 13:03:18.400024 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:18.400034 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:18.400113 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:18.400289 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:03:18.401234 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:18.402553 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:18.403517 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:18.404029 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:18.404166 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:18.407816 (+ 3650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:03:18.407823 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:03:18.407823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:03:18.407839 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:03:18.410168 (+ 2329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:18.410681 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:18.410685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:18.410685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:18.410866 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:18.411111 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:18.411111 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:18.411112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:18.411511 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:03:18.412224 (+ 713us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:18.412313 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 13:03:18.412468 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":131,"threads_started":1}
I20260806 13:03:18.413054 486 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:03:18.414907 491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:03:18.415252 491 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [term 1 LEADER]: Becoming Leader. State: Replica: fa63128880f449f789c35d81e6b646d8, State: Running, Role: LEADER
I20260806 13:03:18.415486 491 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa63128880f449f789c35d81e6b646d8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39087 } }
I20260806 13:03:18.416913 492 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa63128880f449f789c35d81e6b646d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa63128880f449f789c35d81e6b646d8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39087 } } }
I20260806 13:03:18.416929 501 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa63128880f449f789c35d81e6b646d8. Latest consensus state: current_term: 1 leader_uuid: "fa63128880f449f789c35d81e6b646d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa63128880f449f789c35d81e6b646d8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 39087 } } }
I20260806 13:03:18.417208 492 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [sys.catalog]: This master's current role is: LEADER
I20260806 13:03:18.417223 501 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8 [sys.catalog]: This master's current role is: LEADER
I20260806 13:03:18.417371 486 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 13:03:18.417657 505 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:03:18.418637 505 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:03:18.432907 505 catalog_manager.cc:1347] Generated new cluster ID: 4cfe58762b21421e99dd42c1a845368b
I20260806 13:03:18.433101 505 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:03:18.455303 505 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:03:18.456560 505 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:03:18.460393 505 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8: Generated new TSK 0
I20260806 13:03:18.460899 505 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:03:19.495276 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35789/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39087
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:03:19.692065 532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:03:19.692571 532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:03:19.692641 532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:03:19.695910 532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:03:19.696026 532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:03:19.696097 532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:03:19.699810 532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.245.148:35789/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:03:19.700497 532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:03:19.700971 532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:03:19.710393 537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:03:19.710393 538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:03:19.710806 540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:03:19.711386 532 server_base.cc:1034] running on GCE node
I20260806 13:03:19.711694 532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:03:19.712126 532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:03:19.713344 532 hybrid_clock.cc:648] HybridClock initialized: now 1786021399713320 us; error 47 us; skew 500 ppm
Aug 06 13:03:19 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021399, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:03:19.717664 532 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:03:19.718302 532 webserver.cc:460] Webserver started at http://127.20.245.129:44915/ using document root <none> and password file <none>
I20260806 13:03:19.718593 532 fs_manager.cc:359] Metadata directory not provided
I20260806 13:03:19.718672 532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:03:19.718853 532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 13:03:19 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021399, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:03:19.738652 532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "133695a7b8584d69a9a6d33d3e9b5d99"
format_stamp: "Formatted at 2026-08-06 13:03:19 on dist-test-slave-srgv"
server_key: "cf865e0731bdc7134c49c46fc13d801f"
server_key_iv: "3d7e12b4f436c611161c5d0b2b321b05"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:19.739305 532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "133695a7b8584d69a9a6d33d3e9b5d99"
format_stamp: "Formatted at 2026-08-06 13:03:19 on dist-test-slave-srgv"
server_key: "cf865e0731bdc7134c49c46fc13d801f"
server_key_iv: "3d7e12b4f436c611161c5d0b2b321b05"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:19.741787 532 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:03:19.763494 547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:19.763849 532 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260806 13:03:19.764070 532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "133695a7b8584d69a9a6d33d3e9b5d99"
format_stamp: "Formatted at 2026-08-06 13:03:19 on dist-test-slave-srgv"
server_key: "cf865e0731bdc7134c49c46fc13d801f"
server_key_iv: "3d7e12b4f436c611161c5d0b2b321b05"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:19.764215 532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:03:19.792326 532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:03:19.795698 532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:03:19.795975 532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:03:19.796419 532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:03:19.796936 532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:03:19.796985 532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:19.797022 532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:03:19.797044 532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:19.817358 532 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:46365
I20260806 13:03:19.817557 662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:46365 every 8 connection(s)
I20260806 13:03:19.818048 532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:03:19.825232 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 532
I20260806 13:03:19.825390 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:03:19.825676 21462 external_mini_cluster.cc:1428] Setting key e5ac742d1b97ed396663ee45eb17aa35
Aug 06 13:03:19 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021399, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:03:19.836930 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:19.819559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39087 (local address 127.20.245.129:55739)
0806 13:03:19.819980 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:19.820269 (+ 289us) client_negotiation.cc:174] Beginning negotiation
0806 13:03:19.821526 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:03:19.822121 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:03:19.822128 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:03:19.822626 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:03:19.823336 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:19.823346 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:19.824655 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:19.824656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:19.826545 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:19.826549 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:19.827302 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:19.827303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:19.827576 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:19.828565 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:03:19.828580 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:03:19.831087 (+ 2507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:03:19.834087 (+ 3000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:03:19.834105 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:03:19.834109 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:03:19.834712 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:03:19.835047 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:03:19.835048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:03:19.835048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:03:19.835300 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:03:19.835734 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:03:19.835743 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:03:19.836042 (+ 299us) client_negotiation.cc:769] Sending connection context
0806 13:03:19.836190 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 13:03:19.836475 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":225,"threads_started":1}
I20260806 13:03:19.837641 666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:19.820096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:55739 (local address 127.20.245.190:39087)
0806 13:03:19.820283 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:19.820285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:19.820423 (+ 138us) server_negotiation.cc:407] Connection header received
0806 13:03:19.821807 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:19.821810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:19.821832 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:19.821910 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:03:19.823506 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:19.824512 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:19.826680 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:19.827041 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:19.827133 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:19.831311 (+ 4178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:03:19.831313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:03:19.831314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:03:19.831325 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:03:19.833930 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:19.834838 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:19.834840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:19.834841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:19.834955 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:19.835387 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:19.835388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:19.835389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:19.835606 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:03:19.835684 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:19.837315 (+ 1631us) server_negotiation.cc:299] Negotiation successful
0806 13:03:19.837461 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":102,"threads_started":1}
I20260806 13:03:19.838203 663 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39087
I20260806 13:03:19.838366 663 heartbeater.cc:464] Registering TS with master...
I20260806 13:03:19.838672 663 heartbeater.cc:511] Master 127.20.245.190:39087 requested a full tablet report, sending...
I20260806 13:03:19.839499 450 ts_manager.cc:194] Registered new tserver with Master: 133695a7b8584d69a9a6d33d3e9b5d99 (127.20.245.129:46365)
I20260806 13:03:19.840695 450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:55739
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:03:19.868332 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35789/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39087
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 13:03:20 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786021400, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 13:03:20.075016 669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:03:20.075583 669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:03:20.075652 669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:03:20.079061 669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:03:20.079254 669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:03:20.079393 669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:03:20.083884 669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.245.148:35789/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:03:20.084352 669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:03:20.084761 669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:03:20.094467 677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:03:20.095362 679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:03:20.095645 676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:03:20.096421 669 server_base.cc:1034] running on GCE node
I20260806 13:03:20.096755 669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:03:20.097148 669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:03:20.098341 669 hybrid_clock.cc:648] HybridClock initialized: now 1786021400098311 us; error 46 us; skew 500 ppm
Aug 06 13:03:20 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021400, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:03:20.102900 669 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:03:20.103827 669 webserver.cc:460] Webserver started at http://127.20.245.130:37641/ using document root <none> and password file <none>
I20260806 13:03:20.104216 669 fs_manager.cc:359] Metadata directory not provided
I20260806 13:03:20.104316 669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:03:20.104508 669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 13:03:20 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021400, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:03:20.125998 669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "67314786a4ee4564a8f1f01d13fe6a82"
format_stamp: "Formatted at 2026-08-06 13:03:20 on dist-test-slave-srgv"
server_key: "8f3d497f593c7ae4b2942eb5243a0805"
server_key_iv: "3707ea757ae8e79f0a467976239f2149"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:20.126614 669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "67314786a4ee4564a8f1f01d13fe6a82"
format_stamp: "Formatted at 2026-08-06 13:03:20 on dist-test-slave-srgv"
server_key: "8f3d497f593c7ae4b2942eb5243a0805"
server_key_iv: "3707ea757ae8e79f0a467976239f2149"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:20.132769 669 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260806 13:03:20.151868 686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:20.152427 669 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260806 13:03:20.152671 669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "67314786a4ee4564a8f1f01d13fe6a82"
format_stamp: "Formatted at 2026-08-06 13:03:20 on dist-test-slave-srgv"
server_key: "8f3d497f593c7ae4b2942eb5243a0805"
server_key_iv: "3707ea757ae8e79f0a467976239f2149"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:20.152843 669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:03:20.169327 669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:03:20.172634 669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:03:20.172849 669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:03:20.173233 669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:03:20.173934 669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:03:20.174005 669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:20.174057 669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:03:20.174078 669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:20.186450 669 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:41755
I20260806 13:03:20.186657 800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:41755 every 8 connection(s)
I20260806 13:03:20.187347 669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:03:20.195660 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 669
I20260806 13:03:20.195933 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:03:20.196303 21462 external_mini_cluster.cc:1428] Setting key a5176355731650ce98be049f0e10222f
Aug 06 13:03:20 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021400, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:03:20.205687 666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.188833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:33323 (local address 127.20.245.190:39087)
0806 13:03:20.188897 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.188899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.189290 (+ 391us) server_negotiation.cc:407] Connection header received
0806 13:03:20.190161 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.190163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.190189 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.190255 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:03:20.191078 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.191739 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.192925 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.193180 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.193262 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.200007 (+ 6745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:03:20.200010 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:03:20.200011 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:03:20.200024 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:03:20.203072 (+ 3048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:20.204077 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:20.204079 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:20.204080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:20.204185 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:20.204584 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:20.204585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:20.204586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:20.204797 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:03:20.204855 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.205368 (+ 513us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.205515 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 13:03:20.207067 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.188786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39087 (local address 127.20.245.130:33323)
0806 13:03:20.189102 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.189166 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 13:03:20.190010 (+ 844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:03:20.190359 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:03:20.190365 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:03:20.190647 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:03:20.190962 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.190967 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.191870 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.191871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.192817 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.192820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.193287 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.193288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.193438 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.194555 (+ 1117us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:03:20.194567 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:03:20.199789 (+ 5222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:03:20.203309 (+ 3520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:03:20.203332 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:03:20.203338 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:03:20.203937 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:03:20.204283 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:03:20.204284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:03:20.204285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:03:20.204486 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:03:20.204915 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:03:20.204925 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:03:20.205163 (+ 238us) client_negotiation.cc:769] Sending connection context
0806 13:03:20.206276 (+ 1113us) client_negotiation.cc:240] Negotiation successful
0806 13:03:20.206560 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":139,"threads_started":1}
I20260806 13:03:20.208341 801 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39087
I20260806 13:03:20.208499 801 heartbeater.cc:464] Registering TS with master...
I20260806 13:03:20.208794 801 heartbeater.cc:511] Master 127.20.245.190:39087 requested a full tablet report, sending...
I20260806 13:03:20.209334 450 ts_manager.cc:194] Registered new tserver with Master: 67314786a4ee4564a8f1f01d13fe6a82 (127.20.245.130:41755)
I20260806 13:03:20.209970 450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:33323
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:03:20.252255 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35789/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39087
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:03:20.412611 807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:03:20.413149 807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:03:20.413270 807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:03:20.416169 807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:03:20.416401 807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:03:20.416530 807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:03:20.420126 807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.245.148:35789/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:39087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:03:20.420543 807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:03:20.420960 807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:03:20.428004 815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:03:20.428412 807 server_base.cc:1034] running on GCE node
W20260806 13:03:20.428056 812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:03:20.427958 813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:03:20.429077 807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:03:20.429469 807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:03:20.430658 807 hybrid_clock.cc:648] HybridClock initialized: now 1786021400430637 us; error 43 us; skew 500 ppm
Aug 06 13:03:20 dist-test-slave-srgv krb5kdc[32433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021400, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:03:20.434412 807 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:03:20.434974 807 webserver.cc:460] Webserver started at http://127.20.245.131:38105/ using document root <none> and password file <none>
I20260806 13:03:20.435331 807 fs_manager.cc:359] Metadata directory not provided
I20260806 13:03:20.435408 807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:03:20.435590 807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 13:03:20 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021400, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:03:20.462350 807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "49000b71ac4749aa9d9b56cf92eb2d3f"
format_stamp: "Formatted at 2026-08-06 13:03:20 on dist-test-slave-srgv"
server_key: "e1854cde1ff9377e848efd1f772d6203"
server_key_iv: "180c147ca4530e99aef82726db05a7cc"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:20.463660 807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "49000b71ac4749aa9d9b56cf92eb2d3f"
format_stamp: "Formatted at 2026-08-06 13:03:20 on dist-test-slave-srgv"
server_key: "e1854cde1ff9377e848efd1f772d6203"
server_key_iv: "180c147ca4530e99aef82726db05a7cc"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:20.470945 807 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.001s
I20260806 13:03:20.491976 822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:20.492421 807 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260806 13:03:20.492614 807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "49000b71ac4749aa9d9b56cf92eb2d3f"
format_stamp: "Formatted at 2026-08-06 13:03:20 on dist-test-slave-srgv"
server_key: "e1854cde1ff9377e848efd1f772d6203"
server_key_iv: "180c147ca4530e99aef82726db05a7cc"
server_key_version: "kuduclusterkey@0"
I20260806 13:03:20.492851 807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:03:20.515615 807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:03:20.518546 807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:03:20.518774 807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:03:20.519153 807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:03:20.519668 807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:03:20.519726 807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:20.519783 807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:03:20.519825 807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:03:20.534020 807 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:46429
I20260806 13:03:20.534212 939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:46429 every 8 connection(s)
I20260806 13:03:20.534691 807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:03:20.543533 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 807
I20260806 13:03:20.543708 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:03:20.543987 21462 external_mini_cluster.cc:1428] Setting key cbaf66f435d31d54aea4d7355d074829
Aug 06 13:03:20 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021400, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:03:20.550535 666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.535853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:59371 (local address 127.20.245.190:39087)
0806 13:03:20.535987 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.535990 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.536302 (+ 312us) server_negotiation.cc:407] Connection header received
0806 13:03:20.536993 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.536995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.537031 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.537212 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:03:20.538033 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.539437 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.540811 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.541207 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.541323 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.545501 (+ 4178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:03:20.545503 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:03:20.545503 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:03:20.545515 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:03:20.548362 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:20.549101 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:20.549103 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:20.549104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:20.549181 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:20.549549 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:20.549550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:20.549550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:20.549741 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:03:20.549794 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.550288 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.550409 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 13:03:20.551756 942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.535746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:39087 (local address 127.20.245.131:59371)
0806 13:03:20.536076 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.536153 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 13:03:20.536829 (+ 676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:03:20.537358 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:03:20.537363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:03:20.537622 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:03:20.537893 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.537899 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.539619 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.539621 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.540658 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.540662 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.541402 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.541404 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.541566 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.542704 (+ 1138us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:03:20.542715 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:03:20.545371 (+ 2656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:03:20.548520 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:03:20.548541 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:03:20.548545 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:03:20.548990 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:03:20.549274 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:03:20.549275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:03:20.549275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:03:20.549464 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:03:20.549848 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:03:20.549857 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:03:20.550095 (+ 238us) client_negotiation.cc:769] Sending connection context
0806 13:03:20.551059 (+ 964us) client_negotiation.cc:240] Negotiation successful
0806 13:03:20.551340 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":189,"threads_started":1}
I20260806 13:03:20.555749 940 heartbeater.cc:347] Connected to a master server at 127.20.245.190:39087
I20260806 13:03:20.555938 940 heartbeater.cc:464] Registering TS with master...
I20260806 13:03:20.556234 940 heartbeater.cc:511] Master 127.20.245.190:39087 requested a full tablet report, sending...
I20260806 13:03:20.556913 450 ts_manager.cc:194] Registered new tserver with Master: 49000b71ac4749aa9d9b56cf92eb2d3f (127.20.245.131:46429)
I20260806 13:03:20.557425 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:03:20.557548 450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:59371
I20260806 13:03:20.568219 666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.559694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.20.245.190:39087)
0806 13:03:20.559750 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.559753 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.560196 (+ 443us) server_negotiation.cc:407] Connection header received
0806 13:03:20.560341 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.560342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.560357 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.560391 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:03:20.561234 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.561792 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.562717 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.562989 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.563065 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.564983 (+ 1918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:03:20.564985 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:03:20.564985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:03:20.564995 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:03:20.566816 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:20.567291 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:20.567292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:20.567293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:20.567355 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:03:20.567562 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:03:20.567563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:03:20.567563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:03:20.567704 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:03:20.567788 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.568010 (+ 222us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.568098 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 13:03:20.571216 450 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:03:20.573498 450 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:03:20.584847 952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.577489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:46429 (local address 127.0.0.1:58090)
0806 13:03:20.578793 (+ 1304us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.578800 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0806 13:03:20.578859 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:03:20.579392 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:03:20.579397 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:03:20.579403 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:03:20.579510 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.579513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.581221 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.581222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.582597 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.582601 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.584117 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.584118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.584483 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.584513 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 13:03:20.584623 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 13:03:20.584706 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1293,"thread_start_us":86,"threads_started":1}
I20260806 13:03:20.585618 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.577957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58090 (local address 127.20.245.131:46429)
0806 13:03:20.578314 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.578321 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.578872 (+ 551us) server_negotiation.cc:407] Connection header received
0806 13:03:20.578942 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.578945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.578965 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.579251 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:03:20.579608 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.581097 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.582734 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.583762 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.583994 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.584076 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.585367 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.585434 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":104,"threads_started":1}
I20260806 13:03:20.586876 871 tablet_service.cc:1467] Processing CreateTablet for tablet ac470f894939424984c53083f12bcdbb (DEFAULT_TABLE table=test-table [id=df16d6d4e1114f9aa6f0bf794c5d1277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:03:20.587661 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac470f894939424984c53083f12bcdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:03:20.590552 955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.577141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:46365 (local address 127.0.0.1:40626)
0806 13:03:20.578403 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.578467 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 13:03:20.578535 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:03:20.579495 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:03:20.579495 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:03:20.579497 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:03:20.579551 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.579552 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.583270 (+ 3718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.583271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.584517 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.584520 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.590112 (+ 5592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.590113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.590285 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.590293 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 13:03:20.590352 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 13:03:20.590435 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1224,"thread_start_us":144,"threads_started":1}
I20260806 13:03:20.591362 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.577536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40626 (local address 127.20.245.129:46365)
0806 13:03:20.579005 (+ 1469us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.579010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.579022 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:03:20.579063 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.579065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.579085 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.579778 (+ 693us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:03:20.579877 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.583124 (+ 3247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.588223 (+ 5099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.589990 (+ 1767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.590911 (+ 921us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.591020 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.591057 (+ 37us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.591127 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1411,"thread_start_us":80,"threads_started":1}
I20260806 13:03:20.592365 579 tablet_service.cc:1467] Processing CreateTablet for tablet ac470f894939424984c53083f12bcdbb (DEFAULT_TABLE table=test-table [id=df16d6d4e1114f9aa6f0bf794c5d1277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:03:20.592896 579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac470f894939424984c53083f12bcdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:03:20.595747 959 tablet_bootstrap.cc:492] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Bootstrap starting.
I20260806 13:03:20.598037 959 tablet_bootstrap.cc:654] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Neither blocks nor log segments found. Creating new log.
I20260806 13:03:20.599157 959 log.cc:824] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Log is configured to *not* fsync() on all Append() calls
I20260806 13:03:20.599800 960 tablet_bootstrap.cc:492] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99: Bootstrap starting.
I20260806 13:03:20.599874 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.577147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:41755 (local address 127.0.0.1:48236)
0806 13:03:20.578663 (+ 1516us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.578673 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:03:20.578725 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:03:20.579630 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:03:20.579631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:03:20.579632 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:03:20.579680 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.579682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.584636 (+ 4954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.584637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.586683 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.586687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.599434 (+ 12747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.599435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.599608 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.599619 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 13:03:20.599664 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 13:03:20.599752 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1498,"thread_start_us":138,"threads_started":1}
I20260806 13:03:20.600759 957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.577746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48236 (local address 127.20.245.130:41755)
0806 13:03:20.579295 (+ 1549us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.579299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.579310 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:03:20.579357 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.579359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.579378 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.580428 (+ 1050us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:03:20.580550 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.581750 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.586959 (+ 5209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.588097 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.600209 (+ 12112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.600351 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.600393 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.600549 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1498,"thread_start_us":145,"threads_started":1}
I20260806 13:03:20.602072 735 tablet_service.cc:1467] Processing CreateTablet for tablet ac470f894939424984c53083f12bcdbb (DEFAULT_TABLE table=test-table [id=df16d6d4e1114f9aa6f0bf794c5d1277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:03:20.602473 960 tablet_bootstrap.cc:654] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99: Neither blocks nor log segments found. Creating new log.
I20260806 13:03:20.602638 735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac470f894939424984c53083f12bcdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:03:20.603524 960 log.cc:824] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99: Log is configured to *not* fsync() on all Append() calls
I20260806 13:03:20.604987 959 tablet_bootstrap.cc:492] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: No bootstrap required, opened a new log
I20260806 13:03:20.605162 959 ts_tablet_manager.cc:1397] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260806 13:03:20.609717 959 raft_consensus.cc:348] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.610419 959 raft_consensus.cc:374] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:03:20.610503 959 raft_consensus.cc:729] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49000b71ac4749aa9d9b56cf92eb2d3f, State: Initialized, Role: FOLLOWER
I20260806 13:03:20.610703 959 consensus_queue.cc:260] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.611166 959 ts_tablet_manager.cc:1428] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260806 13:03:20.611449 940 heartbeater.cc:503] Master 127.20.245.190:39087 was elected leader, sending a full tablet report...
I20260806 13:03:20.612927 960 tablet_bootstrap.cc:492] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99: No bootstrap required, opened a new log
I20260806 13:03:20.613060 960 ts_tablet_manager.cc:1397] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.003s
I20260806 13:03:20.615741 963 tablet_bootstrap.cc:492] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82: Bootstrap starting.
I20260806 13:03:20.618961 960 raft_consensus.cc:348] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.619287 960 raft_consensus.cc:374] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:03:20.619345 960 raft_consensus.cc:729] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 133695a7b8584d69a9a6d33d3e9b5d99, State: Initialized, Role: FOLLOWER
I20260806 13:03:20.619553 960 consensus_queue.cc:260] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.619887 963 tablet_bootstrap.cc:654] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82: Neither blocks nor log segments found. Creating new log.
I20260806 13:03:20.620088 960 ts_tablet_manager.cc:1428] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99: Time spent starting tablet: real 0.007s user 0.003s sys 0.005s
I20260806 13:03:20.620309 663 heartbeater.cc:503] Master 127.20.245.190:39087 was elected leader, sending a full tablet report...
I20260806 13:03:20.621627 963 log.cc:824] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82: Log is configured to *not* fsync() on all Append() calls
I20260806 13:03:20.623332 963 tablet_bootstrap.cc:492] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82: No bootstrap required, opened a new log
I20260806 13:03:20.623518 963 ts_tablet_manager.cc:1397] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 13:03:20.627053 963 raft_consensus.cc:348] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.627429 963 raft_consensus.cc:374] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:03:20.627493 963 raft_consensus.cc:729] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67314786a4ee4564a8f1f01d13fe6a82, State: Initialized, Role: FOLLOWER
I20260806 13:03:20.627687 963 consensus_queue.cc:260] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.628175 963 ts_tablet_manager.cc:1428] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260806 13:03:20.628232 801 heartbeater.cc:503] Master 127.20.245.190:39087 was elected leader, sending a full tablet report...
W20260806 13:03:20.689043 803 tablet.cc:2369] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:03:20.769512 967 raft_consensus.cc:482] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:03:20.769744 967 raft_consensus.cc:504] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.770380 967 leader_election.cc:288] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 133695a7b8584d69a9a6d33d3e9b5d99 (127.20.245.129:46365), 49000b71ac4749aa9d9b56cf92eb2d3f (127.20.245.131:46429)
Aug 06 13:03:20 dist-test-slave-srgv krb5kdc[32433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021400, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:03:20.778822 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.771372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:54809 (local address 127.20.245.129:46365)
0806 13:03:20.771437 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.771439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.771890 (+ 451us) server_negotiation.cc:407] Connection header received
0806 13:03:20.772027 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.772029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.772048 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.772084 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:03:20.772754 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.773613 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.775591 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.776393 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.776458 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.776471 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.778622 (+ 2151us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.778714 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 13:03:20.779214 969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.770695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:46365 (local address 127.20.245.130:54809)
0806 13:03:20.771791 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.771807 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:03:20.771931 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:03:20.772174 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:03:20.772175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:03:20.772178 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:03:20.772361 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.772365 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.773759 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.773761 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.775469 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.775474 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.778408 (+ 2934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.778410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.778511 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.778518 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:03:20.779014 (+ 496us) client_negotiation.cc:240] Negotiation successful
0806 13:03:20.779080 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1070,"thread_start_us":118,"threads_started":1}
I20260806 13:03:20.779698 610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac470f894939424984c53083f12bcdbb" candidate_uuid: "67314786a4ee4564a8f1f01d13fe6a82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" is_pre_election: true
I20260806 13:03:20.779963 610 raft_consensus.cc:2454] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67314786a4ee4564a8f1f01d13fe6a82 in term 0.
I20260806 13:03:20.780313 688 leader_election.cc:302] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133695a7b8584d69a9a6d33d3e9b5d99, 67314786a4ee4564a8f1f01d13fe6a82; no voters:
I20260806 13:03:20.780501 967 raft_consensus.cc:2781] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:03:20.780550 967 raft_consensus.cc:482] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:03:20.780575 967 raft_consensus.cc:3037] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:03:20.782194 967 raft_consensus.cc:504] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.782392 967 leader_election.cc:288] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [CANDIDATE]: Term 1 election: Requested vote from peers 133695a7b8584d69a9a6d33d3e9b5d99 (127.20.245.129:46365), 49000b71ac4749aa9d9b56cf92eb2d3f (127.20.245.131:46429)
I20260806 13:03:20.782874 610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac470f894939424984c53083f12bcdbb" candidate_uuid: "67314786a4ee4564a8f1f01d13fe6a82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "133695a7b8584d69a9a6d33d3e9b5d99"
I20260806 13:03:20.783005 610 raft_consensus.cc:3037] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:03:20.784632 610 raft_consensus.cc:2454] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67314786a4ee4564a8f1f01d13fe6a82 in term 1.
I20260806 13:03:20.785071 688 leader_election.cc:302] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133695a7b8584d69a9a6d33d3e9b5d99, 67314786a4ee4564a8f1f01d13fe6a82; no voters:
I20260806 13:03:20.785524 967 raft_consensus.cc:2781] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 1 FOLLOWER]: Leader election won for term 1
W20260806 13:03:20.785888 941 tablet.cc:2369] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:03:20.786438 967 raft_consensus.cc:686] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 1 LEADER]: Becoming Leader. State: Replica: 67314786a4ee4564a8f1f01d13fe6a82, State: Running, Role: LEADER
I20260806 13:03:20.786610 967 consensus_queue.cc:237] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } }
I20260806 13:03:20.788239 450 catalog_manager.cc:5495] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67314786a4ee4564a8f1f01d13fe6a82 (127.20.245.130). New cstate: current_term: 1 leader_uuid: "67314786a4ee4564a8f1f01d13fe6a82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67314786a4ee4564a8f1f01d13fe6a82" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 } health_report { overall_health: UNKNOWN } } }
I20260806 13:03:20.790220 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.771221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:45981 (local address 127.20.245.131:46429)
0806 13:03:20.771297 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.771300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.776931 (+ 5631us) server_negotiation.cc:407] Connection header received
0806 13:03:20.777065 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.777067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.777084 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.777124 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:03:20.779234 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.780251 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.784716 (+ 4465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.785403 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.785474 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.785487 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.790049 (+ 4562us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.790146 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 13:03:20.790268 968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.770961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:46429 (local address 127.20.245.130:45981)
0806 13:03:20.776830 (+ 5869us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.776846 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:03:20.776972 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:03:20.777209 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:03:20.777210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:03:20.777212 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:03:20.777519 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.777522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.780514 (+ 2992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.780516 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.782024 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:03:20.782028 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.785567 (+ 3539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.785568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:03:20.789856 (+ 4288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.789869 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 13:03:20.790003 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 13:03:20.790094 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5843,"thread_start_us":54,"threads_started":1}
I20260806 13:03:20.790844 892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac470f894939424984c53083f12bcdbb" candidate_uuid: "67314786a4ee4564a8f1f01d13fe6a82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" is_pre_election: true
I20260806 13:03:20.791050 892 raft_consensus.cc:2454] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67314786a4ee4564a8f1f01d13fe6a82 in term 0.
I20260806 13:03:20.791268 891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac470f894939424984c53083f12bcdbb" candidate_uuid: "67314786a4ee4564a8f1f01d13fe6a82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f"
I20260806 13:03:20.791393 891 raft_consensus.cc:3037] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:03:20.793462 891 raft_consensus.cc:2454] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67314786a4ee4564a8f1f01d13fe6a82 in term 1.
I20260806 13:03:20.818427 957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.814110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48250 (local address 127.20.245.130:41755)
0806 13:03:20.814183 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 13:03:20.814186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:03:20.814199 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:03:20.814283 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:03:20.814285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:03:20.814329 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:03:20.814437 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:03:20.814663 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.815417 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.816592 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:03:20.817052 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:03:20.817148 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:03:20.817440 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:03:20.817665 (+ 225us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:03:20.817764 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 13:03:20.818173 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 13:03:20.818214 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 13:03:20.823547 891 raft_consensus.cc:1261] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 1 FOLLOWER]: Refusing update from remote peer 67314786a4ee4564a8f1f01d13fe6a82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:03:20.824440 970 consensus_queue.cc:1035] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49000b71ac4749aa9d9b56cf92eb2d3f" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 13:03:20.824966 664 tablet.cc:2369] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:03:20.828166 610 raft_consensus.cc:1261] T ac470f894939424984c53083f12bcdbb P 133695a7b8584d69a9a6d33d3e9b5d99 [term 1 FOLLOWER]: Refusing update from remote peer 67314786a4ee4564a8f1f01d13fe6a82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:03:20.828600 970 consensus_queue.cc:1035] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133695a7b8584d69a9a6d33d3e9b5d99" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:03:20.836723 974 mvcc.cc:205] Tried to move back new op lower bound from 7315543657762938880 to 7315543657623093248. Current Snapshot: MvccSnapshot[applied={T|T < 7315543657762938880}]
I20260806 13:03:20.839540 976 mvcc.cc:205] Tried to move back new op lower bound from 7315543657762938880 to 7315543657623093248. Current Snapshot: MvccSnapshot[applied={T|T < 7315543657762938880}]
I20260806 13:03:20.841889 449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:03:20.842068 449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:03:20.843339 449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa63128880f449f789c35d81e6b646d8: Sending DeleteTablet for 3 replicas of tablet ac470f894939424984c53083f12bcdbb
I20260806 13:03:20.843971 735 tablet_service.cc:1514] Processing DeleteTablet for tablet ac470f894939424984c53083f12bcdbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:03:20 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:48236
I20260806 13:03:20.844321 871 tablet_service.cc:1514] Processing DeleteTablet for tablet ac470f894939424984c53083f12bcdbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:03:20 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:58090
I20260806 13:03:20.844800 579 tablet_service.cc:1514] Processing DeleteTablet for tablet ac470f894939424984c53083f12bcdbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:03:20 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:40626
I20260806 13:03:20.845839 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 532
I20260806 13:03:20.855556 984 tablet_replica.cc:330] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: stopping tablet replica
I20260806 13:03:20.855894 983 tablet_replica.cc:330] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82: stopping tablet replica
I20260806 13:03:20.856242 983 raft_consensus.cc:2229] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:03:20.856503 984 raft_consensus.cc:2229] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:03:20.858186 984 raft_consensus.cc:2258] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:03:20.858480 983 raft_consensus.cc:2258] T ac470f894939424984c53083f12bcdbb P 67314786a4ee4564a8f1f01d13fe6a82 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 13:03:20.859102 435 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:46365 (error 108)
I20260806 13:03:20.859745 984 ts_tablet_manager.cc:1905] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:03:20.860298 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 669
I20260806 13:03:20.870155 984 ts_tablet_manager.cc:1918] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:03:20.870352 984 log.cc:1196] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/ac470f894939424984c53083f12bcdbb
I20260806 13:03:20.870802 984 ts_tablet_manager.cc:1939] T ac470f894939424984c53083f12bcdbb P 49000b71ac4749aa9d9b56cf92eb2d3f: Deleting consensus metadata
I20260806 13:03:20.871609 434 catalog_manager.cc:4841] TS 49000b71ac4749aa9d9b56cf92eb2d3f (127.20.245.131:46429): tablet ac470f894939424984c53083f12bcdbb (table test-table [id=df16d6d4e1114f9aa6f0bf794c5d1277]) successfully deleted
I20260806 13:03:20.872535 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.872321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:46365 (local address 127.0.0.1:40642)
0806 13:03:20.872401 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.872483 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:46365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 13:03:20.872891 435 catalog_manager.cc:4584] TS 133695a7b8584d69a9a6d33d3e9b5d99 (127.20.245.129:46365): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ac470f894939424984c53083f12bcdbb: Network error: Client connection negotiation failed: client connection to 127.20.245.129:46365: connect: Connection refused (error 111)
I20260806 13:03:20.874543 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 807
I20260806 13:03:20.876195 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:03:20.876046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:41755 (local address 127.0.0.1:48260)
0806 13:03:20.876115 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 13:03:20.876147 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.130:41755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 13:03:20.881649 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 417
I20260806 13:03:20.889624 21462 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 13:03:21.235592 21462 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 13:03:21.235754 21462 mini_ranger.cc:66] Stopping Ranger...
I20260806 13:03:21.584457 21462 mini_ranger.cc:68] Stopped Ranger
2026-08-06 13:03:21.584 UTC [32463] LOG: received smart shutdown request
2026-08-06 13:03:21.588 UTC [32463] LOG: background worker "logical replication launcher" (PID 32472) exited with exit code 1
2026-08-06 13:03:21.588 UTC [32467] LOG: shutting down
2026-08-06 13:03:21.803 UTC [32463] LOG: database system is shut down
2026-08-06T13:03:21Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (62460 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:03:22 dist-test-slave-srgv krb5kdc[995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:03:22 dist-test-slave-srgv krb5kdc[995](info): set up 2 sockets
Aug 06 13:03:22 dist-test-slave-srgv krb5kdc[995](info): commencing operation
krb5kdc: starting...
W20260806 13:03:23.035741 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:03:23 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:03:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:03:23Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.245.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.245.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/rangeradmin_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/rangeradmin_127.20.245.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.245.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.245.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/rangerlookup_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/rangerlookup_127.20.245.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.245.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.245.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/HTTP_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/HTTP_127.20.245.148@KRBTEST.COM.keytab.
I20260806 13:03:23.256369 21462 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskGJGA6C/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/postgres -l logfile start
2026-08-06 13:03:26.360 UTC [1026] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 13:03:26.361 UTC [1026] LOG: listening on IPv4 address "127.20.245.148", port 47171
2026-08-06 13:03:26.366 UTC [1026] LOG: listening on Unix socket "/tmp/.s.PGSQL.47171"
2026-08-06 13:03:26.395 UTC [1029] LOG: database system was shut down at 2026-08-06 13:03:24 UTC
2026-08-06 13:03:26.399 UTC [1026] LOG: database system is ready to accept connections
I20260806 13:03:27.423343 21462 mini_postgres.cc:96] Postgres bound to 47171
2026-08-06 13:03:27.432 UTC [1038] FATAL: database "slave" does not exist
127.20.245.148:47171 - accepting connections
I20260806 13:03:27.432911 21462 mini_ranger.cc:161] Starting Ranger...
I20260806 13:03:27.454007 21462 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 13:03:28.102159 21462 mini_ranger.cc:87] Created ranger Postgres database
I20260806 13:03:28.102332 21462 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-admin
2026-08-06 13:03:28,411 [I] DB FLAVOR :POSTGRES
2026-08-06 13:03:28,412 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 13:03:28,412 [I] Checking connection..
2026-08-06 13:03:28,412 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 13:03:28,731 [I] Checking connection passed.
2026-08-06 13:03:28,731 [I] --------- Verifying version history table ---------
2026-08-06 13:03:28,731 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 13:03:29,054 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 13:03:29,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 13:03:29,380 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 13:03:29,380 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 13:03:29,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 13:03:29.717 UTC [1102] WARNING: there is no transaction in progress
2026-08-06 13:03:29,728 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 13:03:29,729 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 13:03:30,072 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 13:03:30,072 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 13:03:30,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 13:03:30,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 13:03:30,731 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-srgv.c.gcp-upstream.internal','N') ;"
2026-08-06 13:03:31,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 13:03:31,283 [I] Table x_portal_user does not exist in database ranger
2026-08-06 13:03:31,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 13:03:31,594 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 13:03:31,595 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 13:03:31,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 13:03:32,190 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 13:03:32,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 13:03:33.439 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.463 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.485 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.505 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.524 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.550 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.631 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.640 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.659 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.673 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.687 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.705 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.720 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.728 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.738 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:33.749 UTC [1213] WARNING: there is no transaction in progress
2026-08-06 13:03:34,641 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 13:03:34,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 13:03:34,934 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 13:03:34,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 13:03:35,241 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 13:03:35,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 13:03:35,547 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 13:03:35,548 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 13:03:35,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 13:03:36,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-srgv.c.gcp-upstream.internal';"
2026-08-06 13:03:36,507 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 13:03:36,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 13:03:36,794 [I] DB_PATCHES have already been applied
I20260806 13:03:36.802938 21462 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-admin:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskGJGA6C/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 13:03:36.803050 21462 mini_ranger.cc:193] Using host: 127.20.245.148
I20260806 13:03:36.807644 21462 mini_ranger.cc:227] Ranger admin URL: http://127.20.245.148:47793
Aug 06, 2026 1:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 1:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 1:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 1:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 1:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 1:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 1:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 13:03:37.973444 21462 mini_ranger.cc:160] Time spent starting Ranger: real 10.541s user 0.006s sys 0.007s
Aug 06, 2026 1:04:03 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 1:04:04 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 1:04:04 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 1:04:04 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 1:04:05 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 13:04:06.087057 21462 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.245.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.245.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/rangerkms_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.245.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/rangerkms_127.20.245.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.245.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.245.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.245.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/HTTP_127.20.245.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.245.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/HTTP_127.20.245.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 13:04:06 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021446, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 13:04:06.203456 21462 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 13:04:06.218179 21462 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 13:04:07.434201 21462 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 13:04:07.434341 21462 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms
I20260806 13:04:07.434370 21462 mini_ranger_kms.cc:227] Using postgres at 127.20.245.148:47171
2026-08-06 13:04:07,731 [I] DB FLAVOR :POSTGRES
2026-08-06 13:04:07,732 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 13:04:07,732 [I] Checking connection
2026-08-06 13:04:07,732 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 13:04:08,047 [I] connection success
2026-08-06 13:04:08,047 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 13:04:08,048 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 13:04:08,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 13:04:08,338 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 13:04:08,338 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 13:04:08,338 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 13:04:08,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.245.148:47171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 13:04:08,695 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 13:04:09.431350 21462 mini_ranger_kms.cc:310] Created kms service
I20260806 13:04:09.687939 21462 mini_ranger_kms.cc:326] Created kudu user
I20260806 13:04:09.754432 21462 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 13:04:09 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021446, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:10.330802 21462 mini_ranger_kms.cc:384] Added ranger policy
I20260806 13:04:10.331120 21462 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms:/tmp/dist-test-taskGJGA6C/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskGJGA6C/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 13:04:10.331162 21462 mini_ranger_kms.cc:240] Using host: 127.20.245.148
I20260806 13:04:10.336891 21462 mini_ranger_kms.cc:276] Ranger KMS PID: 1398
I20260806 13:04:10.337008 21462 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.245.148:35095
Aug 06, 2026 1:04:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 1:04:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 1:04:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 1:04:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 1:04:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 1:04:12 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 13:04:12.778357 21462 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.575s user 0.000s sys 0.276s
I20260806 13:04:12.778491 21462 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 13:04:12.778566 21462 mini_ranger_kms.cc:401] 127.20.245.148:35095/kms/v1/keys
Aug 06 13:04:12 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786021452, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.245.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 13:04:13 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021452, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.245.148@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
Aug 06 13:04:13 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021452, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.245.148@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
Aug 06 13:04:16 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:04:16.863837 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33257
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:33257
--ranger_config_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35095/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:16.975539 1449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:16.975896 1449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:16.975925 1449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:16.977380 1449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:16.977452 1449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:16.977468 1449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:16.977481 1449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:16.977525 1449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:16.979487 1449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.245.148:35095/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:33257
--ranger_config_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:16.979839 1449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:16.980165 1449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:16.986507 1455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:16.986492 1457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:16.986502 1454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:16.987249 1449 server_base.cc:1034] running on GCE node
I20260806 13:04:16.987594 1449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:16.988016 1449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:16.989199 1449 hybrid_clock.cc:648] HybridClock initialized: now 1786021456989193 us; error 76 us; skew 500 ppm
Aug 06 13:04:16 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021456, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:16.993016 1449 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:04:16.993753 1449 webserver.cc:460] Webserver started at http://127.20.245.190:45427/ using document root <none> and password file <none>
I20260806 13:04:16.994062 1449 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:16.994113 1449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:16.994319 1449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 13:04:16 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021456, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:17.078181 1449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "fb6b517d41a44f2e82359b493bd7eec6"
format_stamp: "Formatted at 2026-08-06 13:04:17 on dist-test-slave-srgv"
server_key: "5c8dade0795466381393d8421ebfc51c"
server_key_iv: "e24031555831edc0a4fd91b8836231b0"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:17.078807 1449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "fb6b517d41a44f2e82359b493bd7eec6"
format_stamp: "Formatted at 2026-08-06 13:04:17 on dist-test-slave-srgv"
server_key: "5c8dade0795466381393d8421ebfc51c"
server_key_iv: "e24031555831edc0a4fd91b8836231b0"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:17.080977 1449 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:04:17.101640 1464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:17.102092 1449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:17.102270 1449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "fb6b517d41a44f2e82359b493bd7eec6"
format_stamp: "Formatted at 2026-08-06 13:04:17 on dist-test-slave-srgv"
server_key: "5c8dade0795466381393d8421ebfc51c"
server_key_iv: "e24031555831edc0a4fd91b8836231b0"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:17.102424 1449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:17.114318 1449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:17.117286 1449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:17.117542 1449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:17.125267 1449 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:33257
I20260806 13:04:17.125300 1518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:33257 every 8 connection(s)
I20260806 13:04:17.125949 1449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:04:17.127288 1519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:17.130816 1519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Bootstrap starting.
I20260806 13:04:17.131778 1519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:17.132192 1519 log.cc:824] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:17.133224 1519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: No bootstrap required, opened a new log
I20260806 13:04:17.134107 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 1449
I20260806 13:04:17.134236 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:04:17.134469 21462 external_mini_cluster.cc:1428] Setting key 76a787ca537e4c1239b9f2683495ef36
I20260806 13:04:17.136528 1519 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } }
I20260806 13:04:17.136781 1519 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:17.136858 1519 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb6b517d41a44f2e82359b493bd7eec6, State: Initialized, Role: FOLLOWER
I20260806 13:04:17.137072 1519 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } }
I20260806 13:04:17.137187 1519 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:04:17.137248 1519 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:04:17.137327 1519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:17.138379 1519 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } }
I20260806 13:04:17.138543 1519 leader_election.cc:302] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb6b517d41a44f2e82359b493bd7eec6; no voters:
I20260806 13:04:17.138841 1519 leader_election.cc:288] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:04:17.138870 1524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:17.139230 1524 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 1 LEADER]: Becoming Leader. State: Replica: fb6b517d41a44f2e82359b493bd7eec6, State: Running, Role: LEADER
I20260806 13:04:17.139376 1519 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:17.139412 1524 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } }
I20260806 13:04:17.139952 1524 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb6b517d41a44f2e82359b493bd7eec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } } }
I20260806 13:04:17.140161 1524 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:17.140421 1524 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb6b517d41a44f2e82359b493bd7eec6. Latest consensus state: current_term: 1 leader_uuid: "fb6b517d41a44f2e82359b493bd7eec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } } }
I20260806 13:04:17.140552 1524 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:17.140812 1534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:04:17.141383 1519 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 13:04:17.141618 1534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 13:04:17 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:17.153987 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:17.135268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43068 (local address 127.20.245.190:33257)
0806 13:04:17.135570 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:17.135586 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:17.135633 (+ 47us) server_negotiation.cc:407] Connection header received
0806 13:04:17.136514 (+ 881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:17.136532 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:17.136636 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:17.136832 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:17.137999 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:17.139611 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:17.140872 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:17.141637 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:17.141760 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:17.146220 (+ 4460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:17.146283 (+ 63us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:17.146283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:17.146391 (+ 108us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:17.150155 (+ 3764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:17.151141 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:17.151145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:17.151146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:17.151433 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:17.151701 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:17.151701 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:17.151702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:17.152174 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:17.152416 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:17.153024 (+ 608us) server_negotiation.cc:299] Negotiation successful
0806 13:04:17.153252 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":159,"threads_started":1}
I20260806 13:04:17.159920 1534 catalog_manager.cc:1347] Generated new cluster ID: ec262878c4e741f4a7fe5be13ebc17e8
I20260806 13:04:17.160091 1534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:04:17.172546 1534 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:04:17.173761 1534 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:04:17.185747 1534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Generated new TSK 0
I20260806 13:04:17.186419 1534 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:04:18.011006 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33257
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:18.127753 1565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:18.128198 1565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:18.128281 1565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:18.130280 1565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:18.130349 1565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:18.130395 1565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:04:18.132972 1565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.245.148:35095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:18.133381 1565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:18.133818 1565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:18.141119 1570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:18.141120 1571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:18.141407 1573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:18.141319 1565 server_base.cc:1034] running on GCE node
I20260806 13:04:18.141796 1565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:18.142206 1565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:18.143396 1565 hybrid_clock.cc:648] HybridClock initialized: now 1786021458143379 us; error 40 us; skew 500 ppm
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:18.147488 1565 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:04:18.148147 1565 webserver.cc:460] Webserver started at http://127.20.245.129:36925/ using document root <none> and password file <none>
I20260806 13:04:18.148470 1565 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:18.148550 1565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:18.148726 1565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:18.167128 1565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "5fe79c4dcb844f83ba2c5d3591464ab0"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "15fc928dfa8a9bad52f3d8a16213763e"
server_key_iv: "33c0cc9440dcb7351a8dfb48a2fbfed5"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.167783 1565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "5fe79c4dcb844f83ba2c5d3591464ab0"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "15fc928dfa8a9bad52f3d8a16213763e"
server_key_iv: "33c0cc9440dcb7351a8dfb48a2fbfed5"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.170403 1565 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 13:04:18.203431 1580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.203712 1565 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.002s
I20260806 13:04:18.203859 1565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "5fe79c4dcb844f83ba2c5d3591464ab0"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "15fc928dfa8a9bad52f3d8a16213763e"
server_key_iv: "33c0cc9440dcb7351a8dfb48a2fbfed5"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.204016 1565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:18.227981 1565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:18.233914 1565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:18.234200 1565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:18.234617 1565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:18.235152 1565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:18.235261 1565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.235320 1565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:18.235356 1565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.245142 1565 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:45029
I20260806 13:04:18.245923 1565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:04:18.246186 1699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:45029 every 8 connection(s)
I20260806 13:04:18.251761 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 1565
I20260806 13:04:18.251909 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:04:18.252170 21462 external_mini_cluster.cc:1428] Setting key 3fd6b8a7d0a0b18778d9f28b48395c14
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:18.264920 1702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:18.247511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:57749 (local address 127.20.245.190:33257)
0806 13:04:18.247694 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:18.247708 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:18.247978 (+ 270us) server_negotiation.cc:407] Connection header received
0806 13:04:18.248733 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:18.248735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:18.248756 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:18.248833 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:18.249803 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.250452 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.255610 (+ 5158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.256020 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.256141 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:18.260070 (+ 3929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:18.260072 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:18.260073 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:18.260086 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:18.262599 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:18.263393 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:18.263395 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:18.263396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:18.263486 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:18.263887 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:18.263888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:18.263888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:18.264091 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:18.264167 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:18.264645 (+ 478us) server_negotiation.cc:299] Negotiation successful
0806 13:04:18.264773 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":89,"threads_started":1}
I20260806 13:04:18.265239 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:18.247494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33257 (local address 127.20.245.129:57749)
0806 13:04:18.247801 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:18.247854 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:18.248586 (+ 732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:18.248949 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:18.248954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:18.249291 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:18.249655 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:18.249662 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.250571 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.250573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:18.252338 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:18.252343 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.256328 (+ 3985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.256329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:18.256593 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:18.257563 (+ 970us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:18.257579 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:18.259888 (+ 2309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:18.262759 (+ 2871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:18.262774 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:18.262779 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:18.263284 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:18.263579 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:18.263580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:18.263581 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:18.263783 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:18.264177 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:18.264185 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:18.264427 (+ 242us) client_negotiation.cc:769] Sending connection context
0806 13:04:18.264575 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 13:04:18.264830 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":99,"threads_started":1}
I20260806 13:04:18.266396 1700 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33257
I20260806 13:04:18.266541 1700 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:18.266816 1700 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:18.267627 1481 ts_manager.cc:194] Registered new tserver with Master: 5fe79c4dcb844f83ba2c5d3591464ab0 (127.20.245.129:45029)
I20260806 13:04:18.268705 1481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:57749
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:04:18.295269 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33257
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:18.452369 1706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:18.452739 1706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:18.452788 1706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:18.455245 1706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:18.455343 1706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:18.455401 1706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:04:18.458482 1706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.245.148:35095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:18.458887 1706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:18.459307 1706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:18.466060 1716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:18.466420 1713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:18.466531 1714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:18.466440 1706 server_base.cc:1034] running on GCE node
I20260806 13:04:18.466952 1706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:18.467338 1706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:18.468540 1706 hybrid_clock.cc:648] HybridClock initialized: now 1786021458468509 us; error 49 us; skew 500 ppm
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:18.471947 1706 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:04:18.472602 1706 webserver.cc:460] Webserver started at http://127.20.245.130:44377/ using document root <none> and password file <none>
I20260806 13:04:18.472906 1706 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:18.472955 1706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:18.473121 1706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:18.488242 1706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "674acb28723e49d4a579aadbe2d98d92"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "a78d2dde5b7ef2519d5c3bcb1783c394"
server_key_iv: "a14101837b9c65f7c60185efeed7f8e5"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.488929 1706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "674acb28723e49d4a579aadbe2d98d92"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "a78d2dde5b7ef2519d5c3bcb1783c394"
server_key_iv: "a14101837b9c65f7c60185efeed7f8e5"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.495828 1706 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260806 13:04:18.517992 1723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.519430 1706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 13:04:18.519649 1706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "674acb28723e49d4a579aadbe2d98d92"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "a78d2dde5b7ef2519d5c3bcb1783c394"
server_key_iv: "a14101837b9c65f7c60185efeed7f8e5"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.519822 1706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:18.535707 1706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:18.538617 1706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:18.538874 1706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:18.539390 1706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:18.539942 1706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:18.540009 1706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.540073 1706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:18.540103 1706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.549759 1706 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:37339
I20260806 13:04:18.550545 1706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:04:18.553560 1841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:37339 every 8 connection(s)
I20260806 13:04:18.562513 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 1706
I20260806 13:04:18.562685 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:04:18.562938 21462 external_mini_cluster.cc:1428] Setting key 8da707f47154d87bb77611e13da9e9be
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:18.574110 1702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:18.552574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:57743 (local address 127.20.245.190:33257)
0806 13:04:18.552677 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:18.552680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:18.553958 (+ 1278us) server_negotiation.cc:407] Connection header received
0806 13:04:18.554696 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:18.554698 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:18.554725 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:18.554783 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:18.555747 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.556626 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.558302 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.558668 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.558724 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:18.569430 (+ 10706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:18.569434 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:18.569435 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:18.569450 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:18.571756 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:18.572759 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:18.572762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:18.572763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:18.572867 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:18.573196 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:18.573197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:18.573198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:18.573371 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:18.573474 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:18.573854 (+ 380us) server_negotiation.cc:299] Negotiation successful
0806 13:04:18.573990 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 13:04:18.574407 1845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:18.552161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33257 (local address 127.20.245.130:57743)
0806 13:04:18.553774 (+ 1613us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:18.553833 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:18.554555 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:18.554884 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:18.554894 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:18.555233 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:18.555614 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:18.555621 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.556778 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.556780 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:18.558175 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:18.558179 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.558884 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.558886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:18.563704 (+ 4818us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:18.564746 (+ 1042us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:18.564762 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:18.567120 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:18.572140 (+ 5020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:18.572159 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:18.572164 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:18.572628 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:18.572946 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:18.572947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:18.572947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:18.573104 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:18.573469 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:18.573479 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:18.573682 (+ 203us) client_negotiation.cc:769] Sending connection context
0806 13:04:18.573833 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 13:04:18.574047 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1555,"thread_start_us":115,"threads_started":1}
I20260806 13:04:18.575314 1843 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33257
I20260806 13:04:18.575464 1843 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:18.575753 1843 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:18.576448 1481 ts_manager.cc:194] Registered new tserver with Master: 674acb28723e49d4a579aadbe2d98d92 (127.20.245.130:37339)
I20260806 13:04:18.577098 1481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:57743
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:04:18.624425 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33257
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:18.794467 1849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:18.795028 1849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:18.795157 1849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:18.797690 1849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:18.797869 1849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:18.797979 1849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:04:18.801205 1849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.245.148:35095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:18.802160 1849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:18.802817 1849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:18.811826 1855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:18.811995 1849 server_base.cc:1034] running on GCE node
W20260806 13:04:18.811857 1854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:18.816550 1857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:18.817188 1849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:18.817668 1849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:18.818917 1849 hybrid_clock.cc:648] HybridClock initialized: now 1786021458818895 us; error 54 us; skew 500 ppm
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:18.826678 1849 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:04:18.827637 1849 webserver.cc:460] Webserver started at http://127.20.245.131:46747/ using document root <none> and password file <none>
I20260806 13:04:18.828055 1849 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:18.828130 1849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:18.828323 1849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:18.845863 1849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "cb63629377b442e99d16a7d8325f1d80"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "a832b18d7b3e756a5468a10e414e0a4a"
server_key_iv: "4193da29fb0453292703812884c6cdfd"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.847011 1849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "cb63629377b442e99d16a7d8325f1d80"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "a832b18d7b3e756a5468a10e414e0a4a"
server_key_iv: "4193da29fb0453292703812884c6cdfd"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.851738 1849 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.001s
I20260806 13:04:18.877071 1864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.877334 1849 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 13:04:18.877444 1849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "cb63629377b442e99d16a7d8325f1d80"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "a832b18d7b3e756a5468a10e414e0a4a"
server_key_iv: "4193da29fb0453292703812884c6cdfd"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:18.877583 1849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:18.900666 1849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:18.904995 1849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:18.905305 1849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:18.905821 1849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:18.906418 1849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:18.906508 1849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.906577 1849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:18.906625 1849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:18.940570 1849 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:46509
I20260806 13:04:18.941299 1849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:04:18.942338 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 1849
I20260806 13:04:18.942442 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:04:18.942685 21462 external_mini_cluster.cc:1428] Setting key 82189ba751145f407e428b246b642060
I20260806 13:04:18.946841 1982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:46509 every 8 connection(s)
Aug 06 13:04:18 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021458, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:18.970551 1702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:18.948160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:32885 (local address 127.20.245.190:33257)
0806 13:04:18.948223 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:18.948226 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:18.949282 (+ 1056us) server_negotiation.cc:407] Connection header received
0806 13:04:18.950596 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:18.950598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:18.950619 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:18.950654 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:18.952824 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.953721 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.955969 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.956306 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.956365 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:18.965747 (+ 9382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:18.965749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:18.965749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:18.965760 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:18.968166 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:18.968974 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:18.968976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:18.968976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:18.969106 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:18.969581 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:18.969582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:18.969582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:18.969767 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:18.969825 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:18.970309 (+ 484us) server_negotiation.cc:299] Negotiation successful
0806 13:04:18.970434 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:04:18.971874 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:18.948130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33257 (local address 127.20.245.131:32885)
0806 13:04:18.948709 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:18.949103 (+ 394us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:18.950435 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:18.950907 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:18.950913 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:18.951466 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:18.952665 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:18.952678 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.953885 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.953887 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:18.955822 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:18.955827 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:18.956585 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:18.956586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:18.956822 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:18.958363 (+ 1541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:18.958378 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:18.964787 (+ 6409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:18.968329 (+ 3542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:18.968352 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:18.968356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:18.968849 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:18.969227 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:18.969228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:18.969229 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:18.969489 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:18.969862 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:18.969871 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:18.970123 (+ 252us) client_negotiation.cc:769] Sending connection context
0806 13:04:18.971163 (+ 1040us) client_negotiation.cc:240] Negotiation successful
0806 13:04:18.971451 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":247,"threads_started":1}
I20260806 13:04:18.972910 1983 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33257
I20260806 13:04:18.973048 1983 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:18.973340 1983 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:18.973934 1481 ts_manager.cc:194] Registered new tserver with Master: cb63629377b442e99d16a7d8325f1d80 (127.20.245.131:46509)
I20260806 13:04:18.974481 1481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:32885
I20260806 13:04:18.976550 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:04:18.977726 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 1565
I20260806 13:04:18.993201 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 1706
I20260806 13:04:19.006520 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 1849
I20260806 13:04:19.013455 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 1449
I20260806 13:04:19.023826 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33257
--webserver_interface=127.20.245.190
--webserver_port=45427
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:33257
--ranger_config_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35095/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.245.148:35095/kms with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:19.128422 1986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:19.128728 1986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:19.128756 1986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:19.130213 1986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:19.130291 1986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:19.130307 1986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:19.130321 1986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:19.130333 1986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:19.132508 1986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.245.148:35095/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:33257
--ranger_config_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=45427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:19.132865 1986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:19.133174 1986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:19.139611 1991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:19.139617 1994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:19.139650 1992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:19.139969 1986 server_base.cc:1034] running on GCE node
I20260806 13:04:19.140283 1986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:19.140640 1986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:19.141871 1986 hybrid_clock.cc:648] HybridClock initialized: now 1786021459141851 us; error 44 us; skew 500 ppm
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:19.145218 1986 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:04:19.145803 1986 webserver.cc:460] Webserver started at http://127.20.245.190:45427/ using document root <none> and password file <none>
I20260806 13:04:19.146095 1986 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:19.146157 1986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:19.205353 1986 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:19.206415 2003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.206702 1986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:19.206831 1986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "fb6b517d41a44f2e82359b493bd7eec6"
format_stamp: "Formatted at 2026-08-06 13:04:17 on dist-test-slave-srgv"
server_key: "5c8dade0795466381393d8421ebfc51c"
server_key_iv: "e24031555831edc0a4fd91b8836231b0"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:19.207535 1986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:19.231802 1986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:19.234580 1986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:19.234827 1986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:19.241320 1986 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:33257
I20260806 13:04:19.241398 2056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:33257 every 8 connection(s)
I20260806 13:04:19.241971 1986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:04:19.243391 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 1986
I20260806 13:04:19.243772 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:45029
--local_ip_for_outbound_sockets=127.20.245.129
--tserver_master_addrs=127.20.245.190:33257
--webserver_port=36925
--webserver_interface=127.20.245.129
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.245.148:35095/kms with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:04:19.244036 2057 sys_catalog.cc:263] Verifying existing consensus state
I20260806 13:04:19.245013 2057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Bootstrap starting.
I20260806 13:04:19.260236 2057 log.cc:824] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:19.263818 2057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:04:19.264351 2057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Bootstrap complete.
I20260806 13:04:19.268787 2057 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } }
I20260806 13:04:19.269286 2057 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb6b517d41a44f2e82359b493bd7eec6, State: Initialized, Role: FOLLOWER
I20260806 13:04:19.269583 2057 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } }
I20260806 13:04:19.269682 2057 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:04:19.269732 2057 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:04:19.269791 2057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 1 FOLLOWER]: Advancing to term 2
I20260806 13:04:19.271976 2057 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } }
I20260806 13:04:19.272167 2057 leader_election.cc:302] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb6b517d41a44f2e82359b493bd7eec6; no voters:
I20260806 13:04:19.272451 2057 leader_election.cc:288] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 13:04:19.272571 2061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 13:04:19.272846 2057 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:19.272868 2061 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [term 2 LEADER]: Becoming Leader. State: Replica: fb6b517d41a44f2e82359b493bd7eec6, State: Running, Role: LEADER
I20260806 13:04:19.273129 2061 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } }
I20260806 13:04:19.273877 2062 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fb6b517d41a44f2e82359b493bd7eec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } } }
I20260806 13:04:19.273995 2062 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:19.274472 2063 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb6b517d41a44f2e82359b493bd7eec6. Latest consensus state: current_term: 2 leader_uuid: "fb6b517d41a44f2e82359b493bd7eec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb6b517d41a44f2e82359b493bd7eec6" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33257 } } }
I20260806 13:04:19.274557 2071 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:04:19.274557 2063 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:19.274905 2057 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 13:04:19.275314 2071 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:04:19.278659 2071 catalog_manager.cc:1259] Loaded cluster ID: ec262878c4e741f4a7fe5be13ebc17e8
I20260806 13:04:19.278986 2071 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:04:19.281647 2071 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:04:19.282034 2071 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Loaded TSK: 0
I20260806 13:04:19.282354 2071 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 13:04:19.399397 2059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:19.399842 2059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:19.399895 2059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:19.402313 2059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:19.402482 2059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:19.402554 2059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:04:19.405616 2059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.245.148:35095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:45029
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=36925
--tserver_master_addrs=127.20.245.190:33257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:19.406210 2059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:19.406587 2059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:19.414362 2096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:19.414577 2098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:19.414831 2095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:19.415130 2059 server_base.cc:1034] running on GCE node
I20260806 13:04:19.415454 2059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:19.415856 2059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:19.417057 2059 hybrid_clock.cc:648] HybridClock initialized: now 1786021459417029 us; error 45 us; skew 500 ppm
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:19.421339 2059 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:04:19.422111 2059 webserver.cc:460] Webserver started at http://127.20.245.129:36925/ using document root <none> and password file <none>
I20260806 13:04:19.422508 2059 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:19.422652 2059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:19.465602 2059 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 13:04:19.467303 2107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.467542 2059 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:19.467658 2059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "5fe79c4dcb844f83ba2c5d3591464ab0"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "15fc928dfa8a9bad52f3d8a16213763e"
server_key_iv: "33c0cc9440dcb7351a8dfb48a2fbfed5"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:19.468328 2059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:19.489239 2059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:19.492400 2059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:19.492630 2059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:19.492959 2059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:19.493407 2059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:19.493466 2059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.493515 2059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:19.493541 2059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.503046 2059 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:45029
I20260806 13:04:19.503305 2221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:45029 every 8 connection(s)
I20260806 13:04:19.503875 2059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:04:19.509359 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 2059
I20260806 13:04:19.509789 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:37339
--local_ip_for_outbound_sockets=127.20.245.130
--tserver_master_addrs=127.20.245.190:33257
--webserver_port=44377
--webserver_interface=127.20.245.130
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.245.148:35095/kms with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:19.533595 2225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:19.508237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33257 (local address 127.20.245.129:33411)
0806 13:04:19.514035 (+ 5798us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:19.514146 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:19.515136 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:19.516461 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:19.516467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:19.516822 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:19.517214 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:19.517222 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.519285 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.519287 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:19.520835 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:19.520842 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.522104 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.522106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:19.522290 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:19.523261 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:19.523287 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:19.527547 (+ 4260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:19.530819 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:19.530838 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:19.530842 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:19.531357 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:19.531788 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:19.531789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:19.531790 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:19.531977 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:19.532657 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:19.532666 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:19.532870 (+ 204us) client_negotiation.cc:769] Sending connection context
0806 13:04:19.532993 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 13:04:19.533251 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5697,"thread_start_us":135,"threads_started":1}
I20260806 13:04:19.534365 2226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:19.508845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:33411 (local address 127.20.245.190:33257)
0806 13:04:19.515554 (+ 6709us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:19.515570 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:19.515651 (+ 81us) server_negotiation.cc:407] Connection header received
0806 13:04:19.515900 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:19.515911 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:19.516000 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:19.516190 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:19.517401 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.519064 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.520983 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.521772 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.521921 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:19.527828 (+ 5907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:19.527838 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:19.527838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:19.527862 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:19.530643 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:19.531494 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:19.531500 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:19.531500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:19.531694 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:19.532067 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:19.532068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:19.532069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:19.532509 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:19.532619 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:19.533908 (+ 1289us) server_negotiation.cc:299] Negotiation successful
0806 13:04:19.534094 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6604,"thread_start_us":118,"threads_started":1}
I20260806 13:04:19.535498 2223 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33257
I20260806 13:04:19.535652 2223 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:19.535964 2223 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
W20260806 13:04:19.537341 2223 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:33257 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 13:04:19.537438 2223 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:19.537528 2223 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:19.537997 2223 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:19.538081 2223 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
W20260806 13:04:19.538487 2223 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 13:04:19.649889 2227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:19.650357 2227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:19.650424 2227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:19.652909 2227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:19.652992 2227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:19.653031 2227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:04:19.655831 2227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.245.148:35095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:37339
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=44377
--tserver_master_addrs=127.20.245.190:33257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:19.656191 2227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:19.656499 2227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:19.663512 2233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:19.663512 2232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:19.664486 2227 server_base.cc:1034] running on GCE node
W20260806 13:04:19.667541 2235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:19.668033 2227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:19.668507 2227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:19.669720 2227 hybrid_clock.cc:648] HybridClock initialized: now 1786021459669698 us; error 50 us; skew 500 ppm
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:19.673525 2227 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:04:19.674299 2227 webserver.cc:460] Webserver started at http://127.20.245.130:44377/ using document root <none> and password file <none>
I20260806 13:04:19.674580 2227 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:19.674681 2227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:19.700402 2227 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 13:04:19.702005 2243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.702307 2227 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:19.702432 2227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "674acb28723e49d4a579aadbe2d98d92"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "a78d2dde5b7ef2519d5c3bcb1783c394"
server_key_iv: "a14101837b9c65f7c60185efeed7f8e5"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:19.703115 2227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:19.738163 2227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:19.741120 2227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:19.741341 2227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:19.741662 2227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:19.742143 2227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:19.742200 2227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.742251 2227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:19.742278 2227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.751965 2227 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:37339
I20260806 13:04:19.752156 2358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:37339 every 8 connection(s)
I20260806 13:04:19.752540 2227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:04:19.759478 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 2227
I20260806 13:04:19.759872 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.245.148:35095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:46509
--local_ip_for_outbound_sockets=127.20.245.131
--tserver_master_addrs=127.20.245.190:33257
--webserver_port=46747
--webserver_interface=127.20.245.131
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.245.148:35095/kms with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:19.767968 2361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:19.753564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33257 (local address 127.20.245.130:55621)
0806 13:04:19.753752 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:19.753804 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:19.754540 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:19.754883 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:19.754889 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:19.755133 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:19.755471 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:19.755477 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.756282 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.756283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:19.757245 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:19.757248 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.757786 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.757787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:19.757925 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:19.758618 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:19.758628 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:19.762981 (+ 4353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:19.765530 (+ 2549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:19.765546 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:19.765551 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:19.766026 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:19.766326 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:19.766327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:19.766328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:19.766539 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:19.766957 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:19.766966 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:19.767234 (+ 268us) client_negotiation.cc:769] Sending connection context
0806 13:04:19.767382 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 13:04:19.767623 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260806 13:04:19.768716 2226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:19.753554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:55621 (local address 127.20.245.190:33257)
0806 13:04:19.753622 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:19.753625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:19.753901 (+ 276us) server_negotiation.cc:407] Connection header received
0806 13:04:19.754683 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:19.754685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:19.754730 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:19.754793 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:19.755575 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.756161 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.757354 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.757653 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.757748 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:19.763136 (+ 5388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:19.763140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:19.763140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:19.763154 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:19.765375 (+ 2221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:19.766153 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:19.766156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:19.766157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:19.766239 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:19.766643 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:19.766645 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:19.766646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:19.766844 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:19.766924 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:19.768458 (+ 1534us) server_negotiation.cc:299] Negotiation successful
0806 13:04:19.768604 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 13:04:19.769718 2359 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33257
I20260806 13:04:19.769871 2359 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:19.770152 2359 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
W20260806 13:04:19.771111 2359 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:33257 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 13:04:19.771250 2359 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:19.771337 2359 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:19.771816 2359 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:19.771904 2359 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
W20260806 13:04:19.772352 2359 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 13:04:19.889204 2362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:19.889544 2362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:19.889586 2362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:19.890993 2362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:19.891080 2362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:19.891130 2362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:04:19.893476 2362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.245.148:35095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:46509
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=46747
--tserver_master_addrs=127.20.245.190:33257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:19.893823 2362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:19.894125 2362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:19.901554 2371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:19.901554 2368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:19.901589 2369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:19.902159 2362 server_base.cc:1034] running on GCE node
I20260806 13:04:19.902457 2362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:19.902838 2362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:19.904038 2362 hybrid_clock.cc:648] HybridClock initialized: now 1786021459904009 us; error 46 us; skew 500 ppm
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:19.908833 2362 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:04:19.909760 2362 webserver.cc:460] Webserver started at http://127.20.245.131:46747/ using document root <none> and password file <none>
I20260806 13:04:19.910221 2362 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:19.910341 2362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
I20260806 13:04:19.933691 2362 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 13:04:19.936151 2379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.936439 2362 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 13:04:19.936563 2362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "cb63629377b442e99d16a7d8325f1d80"
format_stamp: "Formatted at 2026-08-06 13:04:18 on dist-test-slave-srgv"
server_key: "a832b18d7b3e756a5468a10e414e0a4a"
server_key_iv: "4193da29fb0453292703812884c6cdfd"
server_key_version: "kuduclusterkey@0"
I20260806 13:04:19.937106 2362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:19.955744 2362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:19.958957 2362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:19.959235 2362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:19.959666 2362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:19.960166 2362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:19.960227 2362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.960311 2362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:19.960345 2362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:19.969697 2362 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:46509
I20260806 13:04:19.969910 2496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:46509 every 8 connection(s)
I20260806 13:04:19.970381 2362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:04:19.970947 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 2362
I20260806 13:04:19.982719 2501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:19.971524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43080 (local address 127.20.245.190:33257)
0806 13:04:19.972276 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:19.972278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:19.972620 (+ 342us) server_negotiation.cc:407] Connection header received
0806 13:04:19.972661 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:19.972662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:19.972682 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:19.972748 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:19.973817 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.974691 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.976022 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.976375 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.976436 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:19.978527 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:19.978529 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:19.978529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:19.978539 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:19.980903 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:19.981445 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:19.981447 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:19.981447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:19.981530 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:19.981776 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:19.981777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:19.981777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:19.981938 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:19.982163 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:19.982432 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 13:04:19.982557 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":81,"threads_started":1}
Aug 06 13:04:19 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021459, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:20.000667 2226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:19.971446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:39049 (local address 127.20.245.190:33257)
0806 13:04:19.971540 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:19.971543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:19.977273 (+ 5730us) server_negotiation.cc:407] Connection header received
0806 13:04:19.978205 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:19.978207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:19.978224 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:19.978259 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:19.979943 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.980754 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.982526 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.982831 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.982887 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:19.990128 (+ 7241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:19.990132 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:19.990132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:19.990146 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:19.992359 (+ 2213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:19.998755 (+ 6396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:19.998757 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:19.998758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:19.998883 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:19.999416 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:19.999418 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:19.999419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:19.999662 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:19.999756 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:20.000368 (+ 612us) server_negotiation.cc:299] Negotiation successful
0806 13:04:20.000535 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 13:04:20.001624 2502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:19.971791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33257 (local address 127.20.245.131:39049)
0806 13:04:19.977047 (+ 5256us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:19.977159 (+ 112us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:19.978044 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:19.979014 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:19.979021 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:19.979394 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:19.979795 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:19.979804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.980918 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.980919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:19.982402 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:19.982407 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:19.983288 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:19.983290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:19.983474 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:19.986493 (+ 3019us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:19.986511 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:19.989879 (+ 3368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:19.997964 (+ 8085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:19.997986 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:19.997991 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:19.998595 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:19.998986 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:19.998987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:19.998988 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:19.999307 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:19.999754 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:19.999767 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:20.000021 (+ 254us) client_negotiation.cc:769] Sending connection context
0806 13:04:20.000841 (+ 820us) client_negotiation.cc:240] Negotiation successful
0806 13:04:20.001125 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5154,"thread_start_us":103,"threads_started":1}
I20260806 13:04:20.002363 2497 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33257
I20260806 13:04:20.002516 2497 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:20.002835 2497 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
W20260806 13:04:20.003800 2497 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:33257 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 13:04:20.003888 2497 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:20.003963 2497 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:20.004433 2497 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:20.004519 2497 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
W20260806 13:04:20.004915 2497 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 13:04:20.538715 2223 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:20.538949 2223 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:20.539574 2020 ts_manager.cc:194] Registered new tserver with Master: 5fe79c4dcb844f83ba2c5d3591464ab0 (127.20.245.129:45029)
I20260806 13:04:20.540771 2020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:33411
Aug 06 13:04:20 dist-test-slave-srgv krb5kdc[995](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786021460, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:20.772569 2359 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:20.772825 2359 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:20.773445 2020 ts_manager.cc:194] Registered new tserver with Master: 674acb28723e49d4a579aadbe2d98d92 (127.20.245.130:37339)
I20260806 13:04:20.774160 2020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:55621
I20260806 13:04:21.005122 2497 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:21.005374 2497 heartbeater.cc:511] Master 127.20.245.190:33257 requested a full tablet report, sending...
I20260806 13:04:21.005849 2020 ts_manager.cc:194] Registered new tserver with Master: cb63629377b442e99d16a7d8325f1d80 (127.20.245.131:46509)
I20260806 13:04:21.006484 2020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:39049
I20260806 13:04:21.009564 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:04:21.018666 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.010807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53324 (local address 127.20.245.190:33257)
0806 13:04:21.010957 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:21.010960 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:21.010985 (+ 25us) server_negotiation.cc:407] Connection header received
0806 13:04:21.011050 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:21.011050 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:21.011066 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:21.011138 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:21.011972 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.012549 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.013390 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.013615 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.013690 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.015137 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:21.015139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:21.015140 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:21.015148 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:21.017203 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:21.017651 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:21.017653 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:21.017653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:21.017723 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:21.017929 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:21.017930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:21.017930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:21.018086 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:21.018205 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:21.018320 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 13:04:21.018421 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
I20260806 13:04:21.021057 2020 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:04:21.023236 2020 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:04:21.031248 2530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.027478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39760 (local address 127.20.245.130:37339)
0806 13:04:21.027629 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:21.027634 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:21.027645 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:04:21.027689 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:21.027691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:21.027711 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:21.028050 (+ 339us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:21.028150 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.028903 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.030161 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.030743 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.030860 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.030937 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:21.031061 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 13:04:21.031107 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":90,"threads_started":1}
I20260806 13:04:21.031250 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.026737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:37339 (local address 127.0.0.1:39760)
0806 13:04:21.027205 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:21.027255 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:21.027335 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:21.027847 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:21.027851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:21.027854 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:21.027959 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.027962 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.028995 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.028996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.030091 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.030094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.030859 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.030860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.030947 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.030963 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 13:04:21.031039 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 13:04:21.031104 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":117,"threads_started":1}
I20260806 13:04:21.032619 2289 tablet_service.cc:1467] Processing CreateTablet for tablet 10885a2f70bc404c8b8eac8b1e8248f2 (DEFAULT_TABLE table=test-table [id=604d8996f5204842ba4169ff195bc35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:21.033464 2289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10885a2f70bc404c8b8eac8b1e8248f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:21.036168 2528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.026898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48112 (local address 127.20.245.131:46509)
0806 13:04:21.027088 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:21.027096 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:21.031538 (+ 4442us) server_negotiation.cc:407] Connection header received
0806 13:04:21.031659 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:21.031662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:21.031680 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:21.031744 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:21.032229 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.033255 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.034773 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.035600 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.035663 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.035729 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:21.035996 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 13:04:21.036071 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":81,"threads_started":1}
I20260806 13:04:21.037066 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.026738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:46509 (local address 127.0.0.1:48112)
0806 13:04:21.031465 (+ 4727us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:21.031478 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:21.031574 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:21.032092 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:21.032094 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:21.032096 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:21.032136 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.032137 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.033582 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.033583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.034644 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.034648 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.035820 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.035821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.035883 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.035887 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:04:21.036927 (+ 1040us) client_negotiation.cc:240] Negotiation successful
0806 13:04:21.036983 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4709,"mutex_wait_us":16,"thread_start_us":97,"threads_started":1}
I20260806 13:04:21.038089 2429 tablet_service.cc:1467] Processing CreateTablet for tablet 10885a2f70bc404c8b8eac8b1e8248f2 (DEFAULT_TABLE table=test-table [id=604d8996f5204842ba4169ff195bc35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:21.038566 2429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10885a2f70bc404c8b8eac8b1e8248f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:21.043033 2532 tablet_bootstrap.cc:492] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: Bootstrap starting.
I20260806 13:04:21.043928 2532 tablet_bootstrap.cc:654] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:21.044737 2532 log.cc:824] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:21.045387 2533 tablet_bootstrap.cc:492] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92: Bootstrap starting.
I20260806 13:04:21.046223 2533 tablet_bootstrap.cc:654] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:21.046645 2533 log.cc:824] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:21.047837 2533 tablet_bootstrap.cc:492] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92: No bootstrap required, opened a new log
I20260806 13:04:21.047969 2533 ts_tablet_manager.cc:1397] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:04:21.050518 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.027026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:45029 (local address 127.0.0.1:50742)
0806 13:04:21.033666 (+ 6640us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:21.033680 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:21.033774 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:21.045130 (+ 11356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:21.045132 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:21.045135 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:21.045216 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.045219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.046614 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.046616 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.047874 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.047879 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.050194 (+ 2315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.050196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.050290 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.050295 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:04:21.050353 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 13:04:21.050417 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6616,"thread_start_us":93,"threads_started":1}
I20260806 13:04:21.050661 2533 raft_consensus.cc:348] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.050945 2533 raft_consensus.cc:374] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:21.051033 2533 raft_consensus.cc:729] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674acb28723e49d4a579aadbe2d98d92, State: Initialized, Role: FOLLOWER
I20260806 13:04:21.051261 2533 consensus_queue.cc:260] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.051514 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.027748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50742 (local address 127.20.245.129:45029)
0806 13:04:21.029076 (+ 1328us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:21.029081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:21.044804 (+ 15723us) server_negotiation.cc:407] Connection header received
0806 13:04:21.044929 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:21.044932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:21.044957 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:21.045130 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:21.045324 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.046493 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.047989 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.050008 (+ 2019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.050088 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.050153 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:21.051363 (+ 1210us) server_negotiation.cc:299] Negotiation successful
0806 13:04:21.051421 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1287,"thread_start_us":77,"threads_started":1}
I20260806 13:04:21.051843 2533 ts_tablet_manager.cc:1428] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260806 13:04:21.052039 2359 heartbeater.cc:503] Master 127.20.245.190:33257 was elected leader, sending a full tablet report...
I20260806 13:04:21.052045 2532 tablet_bootstrap.cc:492] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: No bootstrap required, opened a new log
I20260806 13:04:21.052120 2532 ts_tablet_manager.cc:1397] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260806 13:04:21.054770 2532 raft_consensus.cc:348] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.055076 2532 raft_consensus.cc:374] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:21.055140 2532 raft_consensus.cc:729] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb63629377b442e99d16a7d8325f1d80, State: Initialized, Role: FOLLOWER
I20260806 13:04:21.055372 2532 consensus_queue.cc:260] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.055820 2532 ts_tablet_manager.cc:1428] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 13:04:21.055850 2497 heartbeater.cc:503] Master 127.20.245.190:33257 was elected leader, sending a full tablet report...
I20260806 13:04:21.056138 2156 tablet_service.cc:1467] Processing CreateTablet for tablet 10885a2f70bc404c8b8eac8b1e8248f2 (DEFAULT_TABLE table=test-table [id=604d8996f5204842ba4169ff195bc35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:21.056734 2156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10885a2f70bc404c8b8eac8b1e8248f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:21.061122 2538 tablet_bootstrap.cc:492] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0: Bootstrap starting.
I20260806 13:04:21.062180 2538 tablet_bootstrap.cc:654] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:21.062599 2538 log.cc:824] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:21.063741 2538 tablet_bootstrap.cc:492] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0: No bootstrap required, opened a new log
I20260806 13:04:21.063843 2538 ts_tablet_manager.cc:1397] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:04:21.066507 2538 raft_consensus.cc:348] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.066761 2538 raft_consensus.cc:374] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:21.066798 2538 raft_consensus.cc:729] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fe79c4dcb844f83ba2c5d3591464ab0, State: Initialized, Role: FOLLOWER
I20260806 13:04:21.066962 2538 consensus_queue.cc:260] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.067369 2538 ts_tablet_manager.cc:1428] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:04:21.067595 2223 heartbeater.cc:503] Master 127.20.245.190:33257 was elected leader, sending a full tablet report...
Aug 06 13:04:21 dist-test-slave-srgv krb5kdc[995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021460, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for HTTP/127.20.245.148@KRBTEST.COM
W20260806 13:04:21.223361 2498 tablet.cc:2369] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:04:21.254478 2360 tablet.cc:2369] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:04:21.258848 2224 tablet.cc:2369] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:04:21.362941 2540 raft_consensus.cc:482] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:21.363265 2540 raft_consensus.cc:504] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.364017 2540 leader_election.cc:288] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 674acb28723e49d4a579aadbe2d98d92 (127.20.245.130:37339), cb63629377b442e99d16a7d8325f1d80 (127.20.245.131:46509)
I20260806 13:04:21.369379 2528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.364515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:58929 (local address 127.20.245.131:46509)
0806 13:04:21.364574 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:21.364576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:21.365127 (+ 551us) server_negotiation.cc:407] Connection header received
0806 13:04:21.365271 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:21.365272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:21.365289 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:21.365324 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:21.365744 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.366482 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.368100 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.368737 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.368795 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.368808 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:21.369228 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 13:04:21.369291 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 13:04:21.370113 2541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.364289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:46509 (local address 127.20.245.129:58929)
0806 13:04:21.365025 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:21.365040 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:21.365170 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:21.365410 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:21.365411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:21.365413 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:21.365643 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.365646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.366596 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.366597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.367981 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.367986 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.368995 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.368997 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.369115 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.369121 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:04:21.369829 (+ 708us) client_negotiation.cc:240] Negotiation successful
0806 13:04:21.369886 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":474,"threads_started":1}
I20260806 13:04:21.370853 2439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10885a2f70bc404c8b8eac8b1e8248f2" candidate_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb63629377b442e99d16a7d8325f1d80" is_pre_election: true
I20260806 13:04:21.371093 2439 raft_consensus.cc:2454] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fe79c4dcb844f83ba2c5d3591464ab0 in term 0.
I20260806 13:04:21.371493 2108 leader_election.cc:302] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fe79c4dcb844f83ba2c5d3591464ab0, cb63629377b442e99d16a7d8325f1d80; no voters:
I20260806 13:04:21.371742 2540 raft_consensus.cc:2781] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:04:21.371809 2540 raft_consensus.cc:482] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:04:21.371833 2540 raft_consensus.cc:3037] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:21.373943 2540 raft_consensus.cc:504] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.374357 2530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.364503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:39437 (local address 127.20.245.130:37339)
0806 13:04:21.364563 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:21.364566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:21.368774 (+ 4208us) server_negotiation.cc:407] Connection header received
0806 13:04:21.368895 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:21.368897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:21.368910 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:21.368959 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:21.369381 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.370132 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.372855 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.373701 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.373785 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.373802 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:21.374207 (+ 405us) server_negotiation.cc:299] Negotiation successful
0806 13:04:21.374277 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:04:21.374724 2542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.364333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:37339 (local address 127.20.245.129:39437)
0806 13:04:21.368676 (+ 4343us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:21.368691 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:21.368812 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:21.369066 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:21.369067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:21.369069 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:21.369269 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.369271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.370274 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.370275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.372686 (+ 2411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:21.372690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.373945 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.373946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:21.374091 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.374097 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:04:21.374510 (+ 413us) client_negotiation.cc:240] Negotiation successful
0806 13:04:21.374563 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4299,"thread_start_us":573,"threads_started":1}
I20260806 13:04:21.374866 2439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10885a2f70bc404c8b8eac8b1e8248f2" candidate_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb63629377b442e99d16a7d8325f1d80"
I20260806 13:04:21.374989 2439 raft_consensus.cc:3037] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:21.375952 2310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10885a2f70bc404c8b8eac8b1e8248f2" candidate_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674acb28723e49d4a579aadbe2d98d92" is_pre_election: true
I20260806 13:04:21.376158 2310 raft_consensus.cc:2454] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fe79c4dcb844f83ba2c5d3591464ab0 in term 0.
I20260806 13:04:21.376432 2307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10885a2f70bc404c8b8eac8b1e8248f2" candidate_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "674acb28723e49d4a579aadbe2d98d92"
I20260806 13:04:21.376531 2307 raft_consensus.cc:3037] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:21.378185 2307 raft_consensus.cc:2454] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fe79c4dcb844f83ba2c5d3591464ab0 in term 1.
I20260806 13:04:21.378533 2111 leader_election.cc:302] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fe79c4dcb844f83ba2c5d3591464ab0, 674acb28723e49d4a579aadbe2d98d92; no voters:
I20260806 13:04:21.379016 2543 raft_consensus.cc:2781] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:21.379355 2543 raft_consensus.cc:686] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [term 1 LEADER]: Becoming Leader. State: Replica: 5fe79c4dcb844f83ba2c5d3591464ab0, State: Running, Role: LEADER
I20260806 13:04:21.379592 2543 consensus_queue.cc:237] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } }
I20260806 13:04:21.380201 2439 raft_consensus.cc:2454] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fe79c4dcb844f83ba2c5d3591464ab0 in term 1.
I20260806 13:04:21.380497 2540 leader_election.cc:288] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [CANDIDATE]: Term 1 election: Requested vote from peers 674acb28723e49d4a579aadbe2d98d92 (127.20.245.130:37339), cb63629377b442e99d16a7d8325f1d80 (127.20.245.131:46509)
I20260806 13:04:21.381188 2020 catalog_manager.cc:5495] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fe79c4dcb844f83ba2c5d3591464ab0 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fe79c4dcb844f83ba2c5d3591464ab0" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 45029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 } health_report { overall_health: UNKNOWN } } }
I20260806 13:04:21.394445 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.391578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50752 (local address 127.20.245.129:45029)
0806 13:04:21.391639 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:21.391641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:21.391689 (+ 48us) server_negotiation.cc:407] Connection header received
0806 13:04:21.391798 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:21.391799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:21.391831 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:21.391912 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:04:21.392146 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.392698 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.393534 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:21.393754 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:21.393834 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:21.394030 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:04:21.394171 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:04:21.394276 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:21.394295 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 13:04:21.394324 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 13:04:21.397651 2439 raft_consensus.cc:1261] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 1 FOLLOWER]: Refusing update from remote peer 5fe79c4dcb844f83ba2c5d3591464ab0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:21.397621 2307 raft_consensus.cc:1261] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 1 FOLLOWER]: Refusing update from remote peer 5fe79c4dcb844f83ba2c5d3591464ab0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:21.398177 2543 consensus_queue.cc:1035] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb63629377b442e99d16a7d8325f1d80" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:21.398512 2544 consensus_queue.cc:1035] T 10885a2f70bc404c8b8eac8b1e8248f2 P 5fe79c4dcb844f83ba2c5d3591464ab0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "674acb28723e49d4a579aadbe2d98d92" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 37339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:21.404742 2549 mvcc.cc:205] Tried to move back new op lower bound from 7315543905880461312 to 7315543905812439040. Current Snapshot: MvccSnapshot[applied={T|T < 7315543905880461312 or (T in {7315543905880461312})}]
I20260806 13:04:21.407439 2548 mvcc.cc:205] Tried to move back new op lower bound from 7315543905880461312 to 7315543905812439040. Current Snapshot: MvccSnapshot[applied={T|T < 7315543905880461312 or (T in {7315543905880461312})}]
I20260806 13:04:21.412022 2019 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:04:21.412204 2019 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:04:21.413537 2019 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fb6b517d41a44f2e82359b493bd7eec6: Sending DeleteTablet for 3 replicas of tablet 10885a2f70bc404c8b8eac8b1e8248f2
I20260806 13:04:21.414363 2429 tablet_service.cc:1514] Processing DeleteTablet for tablet 10885a2f70bc404c8b8eac8b1e8248f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:21 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:48112
I20260806 13:04:21.415373 2289 tablet_service.cc:1514] Processing DeleteTablet for tablet 10885a2f70bc404c8b8eac8b1e8248f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:21 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:39760
I20260806 13:04:21.415836 2156 tablet_service.cc:1514] Processing DeleteTablet for tablet 10885a2f70bc404c8b8eac8b1e8248f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:21 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:50742
I20260806 13:04:21.416874 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 2059
I20260806 13:04:21.427362 2557 tablet_replica.cc:330] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92: stopping tablet replica
I20260806 13:04:21.427716 2557 raft_consensus.cc:2229] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:21.427824 2556 tablet_replica.cc:330] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: stopping tablet replica
I20260806 13:04:21.427958 2556 raft_consensus.cc:2229] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:21.428097 2557 raft_consensus.cc:2258] T 10885a2f70bc404c8b8eac8b1e8248f2 P 674acb28723e49d4a579aadbe2d98d92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:21.428122 2556 raft_consensus.cc:2258] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 13:04:21.429013 2007 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:45029 (error 108)
I20260806 13:04:21.429054 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 2227
I20260806 13:04:21.430259 2556 ts_tablet_manager.cc:1905] T 10885a2f70bc404c8b8eac8b1e8248f2 P cb63629377b442e99d16a7d8325f1d80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:04:21.438776 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 2362
I20260806 13:04:21.442734 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.442476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:45029 (local address 127.0.0.1:50756)
0806 13:04:21.442559 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:21.442663 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:45029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 13:04:21.443022 2007 catalog_manager.cc:4584] TS 5fe79c4dcb844f83ba2c5d3591464ab0 (127.20.245.129:45029): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10885a2f70bc404c8b8eac8b1e8248f2: Network error: Client connection negotiation failed: client connection to 127.20.245.129:45029: connect: Connection refused (error 111)
I20260806 13:04:21.443410 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.443322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:37339 (local address 127.0.0.1:39762)
0806 13:04:21.443364 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:21.443388 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.130:37339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 13:04:21.447214 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:21.447086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:46509 (local address 127.0.0.1:48114)
0806 13:04:21.447132 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:21.447155 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.131:46509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260806 13:04:21.447532 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 1986
I20260806 13:04:21.454350 21462 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 13:04:21.800237 21462 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 13:04:21.800393 21462 mini_ranger.cc:66] Stopping Ranger...
I20260806 13:04:22.146267 21462 mini_ranger.cc:68] Stopped Ranger
2026-08-06 13:04:22.146 UTC [1026] LOG: received smart shutdown request
2026-08-06 13:04:22.151 UTC [1026] LOG: background worker "logical replication launcher" (PID 1035) exited with exit code 1
2026-08-06 13:04:22.151 UTC [1030] LOG: shutting down
2026-08-06 13:04:22.350 UTC [1026] LOG: database system is shut down
2026-08-06T13:04:22Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (60546 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:04:22 dist-test-slave-srgv krb5kdc[2568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:04:22 dist-test-slave-srgv krb5kdc[2568](info): set up 2 sockets
Aug 06 13:04:22 dist-test-slave-srgv krb5kdc[2568](info): commencing operation
krb5kdc: starting...
W20260806 13:04:23.584640 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:04:23 dist-test-slave-srgv krb5kdc[2568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:04:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:04:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:04:23.727589 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43139
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:43139,127.20.245.189:35147,127.20.245.188:40799
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:23.831835 2582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:23.832172 2582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:23.832217 2582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:23.833628 2582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:23.833710 2582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:23.833737 2582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:23.833768 2582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:23.833813 2582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:23.835661 2582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:43139,127.20.245.189:35147,127.20.245.188:40799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:23.836037 2582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:23.836318 2582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:23.842155 2588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:23.842149 2591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:23.842167 2589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:23.842456 2582 server_base.cc:1034] running on GCE node
I20260806 13:04:23.842816 2582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:23.843168 2582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:23.844385 2582 hybrid_clock.cc:648] HybridClock initialized: now 1786021463844368 us; error 37 us; skew 500 ppm
Aug 06 13:04:23 dist-test-slave-srgv krb5kdc[2568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021463, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:23.847611 2582 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:04:23.848169 2582 webserver.cc:460] Webserver started at http://127.20.245.190:37139/ using document root <none> and password file <none>
I20260806 13:04:23.848431 2582 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:23.848480 2582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:23.848673 2582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:23.850085 2582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "1a48cf7c9a034a8abf8f811ae658d20d"
format_stamp: "Formatted at 2026-08-06 13:04:23 on dist-test-slave-srgv"
server_key: "06d6ee8705079a04481a56e6cb408610"
server_key_iv: "e2e2e08528578170fce29d8d3d121819"
server_key_version: "encryptionkey@0"
I20260806 13:04:23.850518 2582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "1a48cf7c9a034a8abf8f811ae658d20d"
format_stamp: "Formatted at 2026-08-06 13:04:23 on dist-test-slave-srgv"
server_key: "06d6ee8705079a04481a56e6cb408610"
server_key_iv: "e2e2e08528578170fce29d8d3d121819"
server_key_version: "encryptionkey@0"
I20260806 13:04:23.852237 2582 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260806 13:04:23.853173 2599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:23.853412 2582 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:23.853533 2582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "1a48cf7c9a034a8abf8f811ae658d20d"
format_stamp: "Formatted at 2026-08-06 13:04:23 on dist-test-slave-srgv"
server_key: "06d6ee8705079a04481a56e6cb408610"
server_key_iv: "e2e2e08528578170fce29d8d3d121819"
server_key_version: "encryptionkey@0"
I20260806 13:04:23.853613 2582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:23.887576 2582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:23.890678 2582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:23.890846 2582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:23.896855 2582 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:43139
I20260806 13:04:23.897017 2651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:43139 every 8 connection(s)
I20260806 13:04:23.897447 2582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:04:23.898733 2652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:23.900877 2652 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:04:23.906075 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 2582
I20260806 13:04:23.906409 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:04:23.906720 21462 external_mini_cluster.cc:1428] Setting key 2cfcc4ad2f2db02e62307ccce16aac3a
Aug 06 13:04:23 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021463, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:23.913867 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:23.901835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:43139 (local address 127.0.0.1:34156)
0806 13:04:23.902202 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:23.902259 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:23.902898 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:23.903252 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:23.903255 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:23.903612 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:23.903809 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:23.903814 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:23.904935 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:23.904936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:23.905758 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:23.905761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:23.906712 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:23.906713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:23.906798 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:23.907569 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:23.907581 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:23.909635 (+ 2054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:23.911925 (+ 2290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:23.911936 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:23.911940 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:23.912259 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:23.912518 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:23.912519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:23.912520 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:23.912645 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:23.913204 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:23.913212 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:23.913289 (+ 77us) client_negotiation.cc:769] Sending connection context
0806 13:04:23.913378 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 13:04:23.913576 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":4,"spinlock_wait_cycles":1408,"thread_start_us":143,"threads_started":1}
I20260806 13:04:23.913878 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:23.901837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.20.245.190:43139)
0806 13:04:23.902217 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:23.902228 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:23.902382 (+ 154us) server_negotiation.cc:407] Connection header received
0806 13:04:23.903083 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:23.903085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:23.903105 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:23.903239 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:23.903930 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:23.904831 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:23.905897 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:23.906536 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:23.906753 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:23.909750 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:23.909763 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:23.909764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:23.909777 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:23.911803 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:23.912350 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:23.912354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:23.912354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:23.912446 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:23.912711 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:23.912712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:23.912712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:23.913126 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:23.913247 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:23.913441 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 13:04:23.913670 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":109,"server-negotiator.queue_time_us":314,"thread_start_us":131,"threads_started":1}
I20260806 13:04:23.914898 2652 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:04:23.915512 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:23.915338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50772)
0806 13:04:23.915404 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:23.915476 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 13:04:23.915702 2600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
I20260806 13:04:23.916330 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:23.916197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50786)
0806 13:04:23.916262 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:23.916297 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 13:04:23.916487 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:35147: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.245.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab.
Entry for principal kudu/127.20.245.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab.
I20260806 13:04:23.940394 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.189:35147
--webserver_interface=127.20.245.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab
--principal=kudu/127.20.245.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:43139,127.20.245.189:35147,127.20.245.188:40799
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:04:23.965847 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } attempt: 1
I20260806 13:04:23.966785 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:23.966567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50798)
0806 13:04:23.966674 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:23.966733 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 13:04:23.967402 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:23.967249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50806)
0806 13:04:23.967321 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:23.967356 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 13:04:23.967615 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:35147: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
I20260806 13:04:24.035856 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } attempt: 2
I20260806 13:04:24.036549 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.036356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50818)
0806 13:04:24.036436 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.036494 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 13:04:24.037000 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.036889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50826)
0806 13:04:24.036934 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.036970 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260806 13:04:24.037110 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:35147: Network error: Client connection negotiation failed: client connection to 127.20.245.189:35147: connect: Connection refused (error 111)
W20260806 13:04:24.041908 2659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:24.042182 2659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:24.042209 2659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:24.043599 2659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:24.043651 2659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:24.043666 2659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:24.043680 2659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:24.043692 2659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:24.045413 2659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:43139,127.20.245.189:35147,127.20.245.188:40799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab
--principal=kudu/127.20.245.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.189:35147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.245.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:24.045688 2659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:24.045928 2659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:04:24.051792 2659 server_base.cc:1034] running on GCE node
W20260806 13:04:24.051764 2665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:24.051752 2664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:24.051753 2667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:24.052345 2659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:24.052733 2659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:24.053918 2659 hybrid_clock.cc:648] HybridClock initialized: now 1786021464053910 us; error 52 us; skew 500 ppm
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021464, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:24.057303 2659 init.cc:377] Logged in from keytab as kudu/127.20.245.189@KRBTEST.COM (short username kudu)
I20260806 13:04:24.057874 2659 webserver.cc:460] Webserver started at http://127.20.245.189:40245/ using document root <none> and password file <none>
I20260806 13:04:24.058149 2659 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:24.058220 2659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:24.058411 2659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:24.059859 2659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/data/instance:
uuid: "3d058a344e234182810e638ec3e989b5"
format_stamp: "Formatted at 2026-08-06 13:04:24 on dist-test-slave-srgv"
server_key: "3d3376b6e0dace34a789bf8590262351"
server_key_iv: "8bb387dce76e8c037bb6c6bc86642f59"
server_key_version: "encryptionkey@0"
I20260806 13:04:24.060294 2659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/wal/instance:
uuid: "3d058a344e234182810e638ec3e989b5"
format_stamp: "Formatted at 2026-08-06 13:04:24 on dist-test-slave-srgv"
server_key: "3d3376b6e0dace34a789bf8590262351"
server_key_iv: "8bb387dce76e8c037bb6c6bc86642f59"
server_key_version: "encryptionkey@0"
I20260806 13:04:24.061954 2659 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 13:04:24.062817 2675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:24.063086 2659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:24.063217 2659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/wal
uuid: "3d058a344e234182810e638ec3e989b5"
format_stamp: "Formatted at 2026-08-06 13:04:24 on dist-test-slave-srgv"
server_key: "3d3376b6e0dace34a789bf8590262351"
server_key_iv: "8bb387dce76e8c037bb6c6bc86642f59"
server_key_version: "encryptionkey@0"
I20260806 13:04:24.063313 2659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:24.076968 2659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:24.079955 2659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:24.080168 2659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:24.085392 2659 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.189:35147
I20260806 13:04:24.085469 2727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.189:35147 every 8 connection(s)
I20260806 13:04:24.085937 2659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
I20260806 13:04:24.087117 2728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:24.087746 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 2659
I20260806 13:04:24.087888 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-1/wal/instance
I20260806 13:04:24.088112 21462 external_mini_cluster.cc:1428] Setting key 17195c9ccaf0e41e8da395afba0c097b
I20260806 13:04:24.089430 2728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021464, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.245.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.188@KRBTEST.COM" created.
I20260806 13:04:24.103520 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.090503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34160 (local address 127.20.245.190:43139)
0806 13:04:24.090594 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.090597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.090880 (+ 283us) server_negotiation.cc:407] Connection header received
0806 13:04:24.091685 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.091687 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.091705 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.091781 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.092611 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.093234 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.095288 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.095532 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.095599 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.098986 (+ 3387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.098989 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.098989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.099001 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.101326 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.102017 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.102019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.102020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.102097 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.102582 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.102583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.102584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.102750 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.102820 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.103323 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.103427 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 13:04:24.103963 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.090468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:43139 (local address 127.0.0.1:34160)
0806 13:04:24.090698 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.090763 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:24.091548 (+ 785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:24.091873 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:24.091877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:24.092219 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:24.092490 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.092494 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.093356 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.093358 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.095071 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.095077 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.095649 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.095652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.095875 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.096703 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:24.096721 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:24.098841 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:24.101434 (+ 2593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.101448 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.101451 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.101914 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.102186 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.102246 (+ 60us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.102246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.102481 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.102835 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:24.102846 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:24.103114 (+ 268us) client_negotiation.cc:769] Sending connection context
0806 13:04:24.103298 (+ 184us) client_negotiation.cc:240] Negotiation successful
0806 13:04:24.103574 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":111,"threads_started":1}
I20260806 13:04:24.104816 2728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021464, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:04:24.115445 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.105330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50838 (local address 127.20.245.189:35147)
0806 13:04:24.105533 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.105538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.105557 (+ 19us) server_negotiation.cc:407] Connection header received
0806 13:04:24.105580 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.105582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.105599 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.105677 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.106154 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.106932 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.108202 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.108652 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.108731 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.111446 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.111464 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.111464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.111474 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.113771 (+ 2297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.114330 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.114334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.114335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.114447 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.114723 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.114724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.114724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.114945 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.115031 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.115142 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.115330 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":128,"threads_started":1}
I20260806 13:04:24.115537 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.105257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50838)
0806 13:04:24.105308 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.105322 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:24.105371 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:24.105711 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:24.105713 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:24.105925 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:24.106023 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.106025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.107041 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.107042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.108105 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.108108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.108754 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.108756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.108861 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.109435 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:24.109442 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:24.111340 (+ 1898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:24.113872 (+ 2532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.113873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.113873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.114076 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.114545 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.114546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.114546 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.114630 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.115015 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:24.115016 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:24.115059 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 13:04:24.115113 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 13:04:24.115411 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":50}
I20260806 13:04:24.116410 2728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:04:24.116880 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.116725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55586)
0806 13:04:24.116799 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.116859 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 13:04:24.117019 2679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
I20260806 13:04:24.117461 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.117366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55588)
0806 13:04:24.117414 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.117440 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 13:04:24.117570 2728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:40799: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab.
Entry for principal kudu/127.20.245.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab.
I20260806 13:04:24.123980 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.188:40799
--webserver_interface=127.20.245.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab
--principal=kudu/127.20.245.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:43139,127.20.245.189:35147,127.20.245.188:40799
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:04:24.128306 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } attempt: 3
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021463, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:04:24.137357 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.129073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50844 (local address 127.20.245.189:35147)
0806 13:04:24.129154 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.129157 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.129170 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:04:24.129213 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.129214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.129225 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.129294 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.129686 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.130278 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.131021 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.131307 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.131394 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.134158 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.134160 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.134160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.134169 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.135968 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.136464 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.136465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.136465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.136526 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.136779 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.136779 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.136780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.136906 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.136960 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.137186 (+ 226us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.137268 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 13:04:24.137545 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.128871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50844)
0806 13:04:24.128983 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.129001 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:24.129112 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:24.129303 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:24.129304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:24.129509 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:24.129597 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.129600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.130382 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.130383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.130938 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.130940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.131395 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.131396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.131488 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.132149 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:24.132155 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:24.134044 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:24.136069 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.136071 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.136072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.136376 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.136613 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.136615 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.136616 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.136709 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.136977 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:24.136978 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:24.137049 (+ 71us) client_negotiation.cc:769] Sending connection context
0806 13:04:24.137145 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 13:04:24.137291 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 13:04:24.138078 2652 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:04:24.138536 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.138410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55590)
0806 13:04:24.138463 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.138504 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 13:04:24.138892 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.138793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55598)
0806 13:04:24.138838 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.138869 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 13:04:24.138998 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:40799: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
I20260806 13:04:24.166838 2728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } attempt: 1
I20260806 13:04:24.167623 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.167410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55614)
0806 13:04:24.167503 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.167561 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 13:04:24.168009 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.167918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55620)
0806 13:04:24.167959 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.167989 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 13:04:24.168107 2728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:40799: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
I20260806 13:04:24.170149 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } attempt: 1
I20260806 13:04:24.170620 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.170475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55622)
0806 13:04:24.170544 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.170584 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 13:04:24.171015 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.170924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55632)
0806 13:04:24.170966 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.170993 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 13:04:24.171128 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:40799: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
W20260806 13:04:24.228917 2736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:24.229235 2736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:24.229267 2736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:24.230736 2736 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:24.230793 2736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:24.230809 2736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:24.230858 2736 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:24.230887 2736 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:24.232791 2736 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:43139,127.20.245.189:35147,127.20.245.188:40799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab
--principal=kudu/127.20.245.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.188:40799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.245.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:24.233150 2736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:24.233470 2736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:04:24.236249 2728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } attempt: 2
I20260806 13:04:24.236886 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.236719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55644)
0806 13:04:24.236797 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.236846 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 13:04:24.237278 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.237175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55646)
0806 13:04:24.237223 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.237250 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 13:04:24.237375 2728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:40799: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
W20260806 13:04:24.239722 2743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:24.239701 2745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:24.239701 2742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:24.240203 2736 server_base.cc:1034] running on GCE node
I20260806 13:04:24.240573 2736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:24.241000 2736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:24.242182 2736 hybrid_clock.cc:648] HybridClock initialized: now 1786021464242164 us; error 43 us; skew 500 ppm
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021464, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:24.245438 2736 init.cc:377] Logged in from keytab as kudu/127.20.245.188@KRBTEST.COM (short username kudu)
I20260806 13:04:24.246085 2736 webserver.cc:460] Webserver started at http://127.20.245.188:37489/ using document root <none> and password file <none>
I20260806 13:04:24.246376 2736 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:24.246304 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } attempt: 2
I20260806 13:04:24.246454 2736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:24.246640 2736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:24.247285 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.247040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55650)
0806 13:04:24.247122 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.247218 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 13:04:24.247721 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.247608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55662)
0806 13:04:24.247663 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.247696 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 13:04:24.247839 2652 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:40799: Network error: Client connection negotiation failed: client connection to 127.20.245.188:40799: connect: Connection refused (error 111)
I20260806 13:04:24.248405 2736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/data/instance:
uuid: "f526973e875246eaa3d0d332b00aa70a"
format_stamp: "Formatted at 2026-08-06 13:04:24 on dist-test-slave-srgv"
server_key: "164719ee685bb4b750cb956bb8ee7549"
server_key_iv: "aa0042d9f8656f4a1508ecb5e9118965"
server_key_version: "encryptionkey@0"
I20260806 13:04:24.248862 2736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/wal/instance:
uuid: "f526973e875246eaa3d0d332b00aa70a"
format_stamp: "Formatted at 2026-08-06 13:04:24 on dist-test-slave-srgv"
server_key: "164719ee685bb4b750cb956bb8ee7549"
server_key_iv: "aa0042d9f8656f4a1508ecb5e9118965"
server_key_version: "encryptionkey@0"
I20260806 13:04:24.250590 2736 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 13:04:24.251722 2752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:24.251957 2736 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:04:24.252112 2736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/wal
uuid: "f526973e875246eaa3d0d332b00aa70a"
format_stamp: "Formatted at 2026-08-06 13:04:24 on dist-test-slave-srgv"
server_key: "164719ee685bb4b750cb956bb8ee7549"
server_key_iv: "aa0042d9f8656f4a1508ecb5e9118965"
server_key_version: "encryptionkey@0"
I20260806 13:04:24.252213 2736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:24.272866 2736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:24.275238 2736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:24.275429 2736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:24.280426 2736 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.188:40799
I20260806 13:04:24.280467 2805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.188:40799 every 8 connection(s)
I20260806 13:04:24.280922 2736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
I20260806 13:04:24.281251 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 2736
I20260806 13:04:24.281406 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786021275077601-21462-0/minicluster-data/master-2/wal/instance
I20260806 13:04:24.281658 21462 external_mini_cluster.cc:1428] Setting key 3c6d33c442719e9d7ae1bf4192c45f63
I20260806 13:04:24.282254 2806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:24.284838 2806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021464, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:24.295296 2811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.285564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:43139 (local address 127.0.0.1:34168)
0806 13:04:24.285808 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.285853 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:24.285930 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:24.286096 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:24.286099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:24.286515 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:24.286611 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.286612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.287587 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.287588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.288540 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.288542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.289054 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.289055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.289149 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.289682 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:24.289692 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:24.292004 (+ 2312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:24.293940 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.293947 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.293950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.294239 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.294436 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.294437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.294437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.294505 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.294814 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:24.294821 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:24.294870 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 13:04:24.294965 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 13:04:24.295066 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":146,"threads_started":1}
I20260806 13:04:24.295334 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.285745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34168 (local address 127.20.245.190:43139)
0806 13:04:24.285811 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.285814 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.285926 (+ 112us) server_negotiation.cc:407] Connection header received
0806 13:04:24.285993 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.285994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.286005 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.286061 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.286690 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.287482 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.288663 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.288945 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.289008 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.292112 (+ 3104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.292114 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.292115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.292123 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.293853 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.294316 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.294317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.294317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.294372 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.294570 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.294571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.294571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.294726 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.294814 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.295108 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.295257 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 13:04:24.295296 2809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.282336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55666 (local address 127.20.245.188:40799)
0806 13:04:24.282566 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.282578 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.282683 (+ 105us) server_negotiation.cc:407] Connection header received
0806 13:04:24.283673 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.283683 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.283752 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.283948 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.284778 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.286394 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.287573 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.288335 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.288469 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.291476 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.291488 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.291489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.291499 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.293269 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.293718 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.293721 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.293722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.293845 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.294090 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.294091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.294091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.294486 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.294653 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.294798 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.294961 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":93,"threads_started":1}
I20260806 13:04:24.295979 2806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021464, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:24.304342 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.296420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50846 (local address 127.20.245.189:35147)
0806 13:04:24.296477 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.296480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.296489 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:04:24.296522 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.296523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.296535 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.296589 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.296830 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.297587 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.298461 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.298784 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.298869 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.301106 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.301108 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.301108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.301117 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.302897 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.303392 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.303394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.303395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.303460 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.303658 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.303658 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.303659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.303846 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.303924 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.304099 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.304201 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:04:24.304353 2811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.296335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:35147 (local address 127.0.0.1:50846)
0806 13:04:24.296376 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.296388 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:24.296428 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:24.296590 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:24.296591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:24.296722 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:24.296772 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.296774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.297668 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.297670 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.298377 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.298380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.298865 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.298866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.298941 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.299587 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:24.299591 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:24.301007 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:24.302991 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.302993 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.302993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.303317 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.303538 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.303539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.303539 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.303596 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.303920 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:24.303920 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:24.303996 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 13:04:24.304070 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 13:04:24.304200 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260806 13:04:24.304677 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.296316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34178 (local address 127.20.245.190:43139)
0806 13:04:24.296631 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.296632 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.296638 (+ 6us) server_negotiation.cc:407] Connection header received
0806 13:04:24.296655 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.296655 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.296664 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.296724 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.297380 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.298028 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.298938 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.299259 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.299324 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.301714 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.301716 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.301716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.301725 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.303247 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.303707 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.303708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.303708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.303769 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.303969 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.303970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.303970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.304114 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.304400 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.304446 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.304566 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 13:04:24.305102 2806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021464, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:04:24.312703 2809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.305505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55676 (local address 127.20.245.188:40799)
0806 13:04:24.305549 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.305551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.305561 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:04:24.305621 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.305621 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.305633 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.305679 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.305983 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.306644 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.307444 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.307788 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.307845 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.309858 (+ 2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.309860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.309860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.309866 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.311529 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.311874 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.311875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.311876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.311930 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.312120 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.312121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.312121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.312244 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.312317 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.312459 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.312567 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 13:04:24.312708 2811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.305461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55676)
0806 13:04:24.305500 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.305514 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:24.305556 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:24.305689 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:24.305690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:24.305869 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:24.305911 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.305913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.306714 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.306715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.307376 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.307379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.307853 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.307854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.307918 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.308385 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:24.308389 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:24.309775 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:24.311610 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.311611 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.311611 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.311786 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.311998 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.311999 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.311999 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.312055 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.312318 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:24.312319 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:24.312356 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 13:04:24.312437 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 13:04:24.312618 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19,"mutex_wait_us":86}
I20260806 13:04:24.313530 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.305534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50860 (local address 127.20.245.189:35147)
0806 13:04:24.305576 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.305578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.305614 (+ 36us) server_negotiation.cc:407] Connection header received
0806 13:04:24.305689 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.305690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.305700 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.305759 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.306333 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.306852 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.307631 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.307860 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.307928 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.310445 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.310446 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.310447 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.310454 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.312027 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.312388 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.312389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.312390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.312446 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.312636 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.312637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.312638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.312791 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.313022 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.313393 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.313455 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 13:04:24.314777 2806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a: Bootstrap starting.
I20260806 13:04:24.315446 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:04:24.316004 2806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:24.316337 2806 log.cc:824] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:24.317279 2806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a: No bootstrap required, opened a new log
I20260806 13:04:24.319821 2806 raft_consensus.cc:348] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.320020 2806 raft_consensus.cc:374] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:24.320075 2806 raft_consensus.cc:729] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f526973e875246eaa3d0d332b00aa70a, State: Initialized, Role: FOLLOWER
I20260806 13:04:24.320245 2806 consensus_queue.cc:260] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.320704 2806 sys_catalog.cc:564] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:24.323310 2820 sys_catalog.cc:455] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.325045 2820 sys_catalog.cc:458] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: This master's current role is: FOLLOWER
W20260806 13:04:24.325788 2831 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:04:24.325888 2831 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:04:24.327404 2809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.317083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55684 (local address 127.20.245.188:40799)
0806 13:04:24.317126 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.317129 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.317488 (+ 359us) server_negotiation.cc:407] Connection header received
0806 13:04:24.317563 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.317564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.317575 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.317622 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.318571 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.319374 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.320933 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.321243 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.321289 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.323220 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.323222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.323223 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.323230 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.325567 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.326110 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.326111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.326112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.326181 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.326417 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.326418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.326419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.326632 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.326735 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.327058 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.327148 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 13:04:24.327404 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.317263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50874 (local address 127.20.245.189:35147)
0806 13:04:24.317305 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.317307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.317457 (+ 150us) server_negotiation.cc:407] Connection header received
0806 13:04:24.317566 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.317567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.317579 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.317612 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.318615 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.319393 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.320591 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.320900 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.320944 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.323247 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.323249 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.323249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.323258 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.325694 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.326250 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.326252 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.326253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.326328 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.326530 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.326531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.326531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.326672 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.326758 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.327162 (+ 404us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.327303 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 13:04:24.325161 2736 master_runner.cc:186] Error getting master registration for 127.20.245.190:43139: OK, instance_id { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" instance_seqno: 1786021463895031 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 13:04:24.328207 2736 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 13:04:24.329164 2728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } attempt: 3
I20260806 13:04:24.330914 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.317292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34188 (local address 127.20.245.190:43139)
0806 13:04:24.317346 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.317348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.317385 (+ 37us) server_negotiation.cc:407] Connection header received
0806 13:04:24.317635 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.317636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.317648 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.317682 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.318610 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.319392 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.320590 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.320900 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.320944 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.323134 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.323137 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.323137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.323148 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.329042 (+ 5894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.329894 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.329896 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.329897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.329982 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.330245 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.330247 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.330247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.330402 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.330528 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.330668 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.330776 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021464, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:04:24.337848 2809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.329584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55694 (local address 127.20.245.188:40799)
0806 13:04:24.329624 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.329626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.329634 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:04:24.329697 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.329698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.329711 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.329777 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.330119 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.330908 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.331984 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.332275 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.332344 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.334795 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.334796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.334797 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.334805 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.336337 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.337061 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.337062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.337062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.337126 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.337329 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.337331 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.337331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.337455 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.337537 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.337698 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.337773 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 13:04:24.337890 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.329492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55694)
0806 13:04:24.329558 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.329572 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:24.329628 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:24.329780 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:24.329781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:24.329966 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:24.330044 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.330047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.331014 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.331016 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.331903 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.331907 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.332364 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.332365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.332430 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.333219 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:24.333225 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:24.334707 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:24.336440 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.336442 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.336443 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.336620 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.337195 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.337196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.337196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.337266 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.337530 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:24.337531 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:24.337585 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 13:04:24.337666 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 13:04:24.337785 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 13:04:24.340122 2728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: Bootstrap starting.
I20260806 13:04:24.341114 2728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:24.341491 2728 log.cc:824] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:24.342845 2728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: No bootstrap required, opened a new log
I20260806 13:04:24.345253 2728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.345463 2728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:24.345504 2728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d058a344e234182810e638ec3e989b5, State: Initialized, Role: FOLLOWER
I20260806 13:04:24.345671 2728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.346015 2834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.346088 2728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:24.346128 2834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:04:24.346974 2652 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } attempt: 3
W20260806 13:04:24.349443 2845 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:04:24.349538 2845 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:04:24.348867 2659 master_runner.cc:186] Error getting master registration for 127.20.245.190:43139: OK, instance_id { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" instance_seqno: 1786021463895031 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 13:04:24.352447 2659 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 13:04:24 dist-test-slave-srgv krb5kdc[2568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021463, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:04:24.357445 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.347364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:40799 (local address 127.0.0.1:55706)
0806 13:04:24.347430 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:24.347444 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:24.347489 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:24.347669 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:24.347670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:24.347982 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:24.348106 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.348110 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.349522 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.349524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.350569 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:24.350574 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.351086 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.351087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:24.351155 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.351811 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:24.351817 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:24.353391 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:24.355426 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.355428 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.355428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.355648 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.355875 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:24.355876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:24.355877 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:24.355946 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:24.357075 (+ 1129us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:24.357076 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:24.357136 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 13:04:24.357211 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 13:04:24.357331 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 13:04:24.357476 2809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:24.347420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55706 (local address 127.20.245.188:40799)
0806 13:04:24.347466 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:24.347469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:24.347479 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:04:24.347567 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:24.347569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:24.347583 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:24.348193 (+ 610us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:24.348229 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.349349 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.350681 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:24.350996 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:24.353467 (+ 2471us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:24.353517 (+ 50us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:24.353518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:24.353519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:24.353522 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:24.355295 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.355734 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.355735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.355736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.355809 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:24.356859 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:24.356860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:24.356860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:24.357005 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:24.357086 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:24.357238 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 13:04:24.357331 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 13:04:24.359635 2652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: Bootstrap starting.
I20260806 13:04:24.360448 2652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:24.360787 2652 log.cc:824] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:24.361629 2652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: No bootstrap required, opened a new log
I20260806 13:04:24.364487 2652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.364653 2652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:24.364701 2652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a48cf7c9a034a8abf8f811ae658d20d, State: Initialized, Role: FOLLOWER
I20260806 13:04:24.364845 2652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.365231 2849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.365327 2652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:24.365382 2849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [sys.catalog]: This master's current role is: FOLLOWER
W20260806 13:04:24.367659 2860 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:04:24.367797 2860 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:04:24.370344 2582 master_runner.cc:263] No leader master found from master 1a48cf7c9a034a8abf8f811ae658d20d
I20260806 13:04:24.370419 2582 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 13:04:24.391952 2605 tablet.cc:2369] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:04:24.526301 2758 tablet.cc:2369] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:04:24.578449 2820 raft_consensus.cc:482] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:24.578709 2820 raft_consensus.cc:504] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.579118 2820 leader_election.cc:288] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a48cf7c9a034a8abf8f811ae658d20d (127.20.245.190:43139), 3d058a344e234182810e638ec3e989b5 (127.20.245.189:35147)
I20260806 13:04:24.579663 2702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f526973e875246eaa3d0d332b00aa70a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d058a344e234182810e638ec3e989b5" is_pre_election: true
I20260806 13:04:24.579686 2626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f526973e875246eaa3d0d332b00aa70a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" is_pre_election: true
I20260806 13:04:24.579878 2702 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f526973e875246eaa3d0d332b00aa70a in term 0.
I20260806 13:04:24.579892 2626 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f526973e875246eaa3d0d332b00aa70a in term 0.
I20260806 13:04:24.580157 2753 leader_election.cc:302] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d058a344e234182810e638ec3e989b5, f526973e875246eaa3d0d332b00aa70a; no voters:
I20260806 13:04:24.580340 2820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:04:24.580411 2820 raft_consensus.cc:482] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:04:24.580430 2820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 0 FOLLOWER]: Advancing to term 1
W20260806 13:04:24.581163 2681 tablet.cc:2369] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:04:24.581539 2820 raft_consensus.cc:504] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.581730 2820 leader_election.cc:288] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [CANDIDATE]: Term 1 election: Requested vote from peers 1a48cf7c9a034a8abf8f811ae658d20d (127.20.245.190:43139), 3d058a344e234182810e638ec3e989b5 (127.20.245.189:35147)
I20260806 13:04:24.581979 2702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f526973e875246eaa3d0d332b00aa70a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d058a344e234182810e638ec3e989b5"
I20260806 13:04:24.582008 2626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f526973e875246eaa3d0d332b00aa70a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a48cf7c9a034a8abf8f811ae658d20d"
I20260806 13:04:24.582090 2702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:24.582157 2626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:24.583107 2626 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f526973e875246eaa3d0d332b00aa70a in term 1.
I20260806 13:04:24.583112 2702 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f526973e875246eaa3d0d332b00aa70a in term 1.
I20260806 13:04:24.583387 2753 leader_election.cc:302] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d058a344e234182810e638ec3e989b5, f526973e875246eaa3d0d332b00aa70a; no voters:
I20260806 13:04:24.583532 2820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:24.583781 2820 raft_consensus.cc:686] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [term 1 LEADER]: Becoming Leader. State: Replica: f526973e875246eaa3d0d332b00aa70a, State: Running, Role: LEADER
I20260806 13:04:24.583954 2820 consensus_queue.cc:237] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } }
I20260806 13:04:24.584532 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f526973e875246eaa3d0d332b00aa70a. Latest consensus state: current_term: 1 leader_uuid: "f526973e875246eaa3d0d332b00aa70a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.584645 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:24.584929 2864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:04:24.585234 2864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:04:24.586969 2702 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [term 1 FOLLOWER]: Refusing update from remote peer f526973e875246eaa3d0d332b00aa70a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:24.586969 2626 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [term 1 FOLLOWER]: Refusing update from remote peer f526973e875246eaa3d0d332b00aa70a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:24.587530 2820 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:24.587675 2862 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:24.589498 2849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f526973e875246eaa3d0d332b00aa70a. Latest consensus state: current_term: 1 leader_uuid: "f526973e875246eaa3d0d332b00aa70a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.589641 2849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:04:24.589502 2834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f526973e875246eaa3d0d332b00aa70a. Latest consensus state: current_term: 1 leader_uuid: "f526973e875246eaa3d0d332b00aa70a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.589707 2834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:04:24.590581 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f526973e875246eaa3d0d332b00aa70a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.590734 2865 mvcc.cc:205] Tried to move back new op lower bound from 7315543918945525760 to 7315543918936723456. Current Snapshot: MvccSnapshot[applied={T|T < 7315543918945525760}]
I20260806 13:04:24.590691 2820 sys_catalog.cc:455] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f526973e875246eaa3d0d332b00aa70a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.590811 2820 sys_catalog.cc:458] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:24.590706 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:24.590866 2849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f526973e875246eaa3d0d332b00aa70a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.590946 2849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:04:24.590911 2834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f526973e875246eaa3d0d332b00aa70a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a48cf7c9a034a8abf8f811ae658d20d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43139 } } peers { permanent_uuid: "3d058a344e234182810e638ec3e989b5" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 35147 } } peers { permanent_uuid: "f526973e875246eaa3d0d332b00aa70a" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 40799 } } }
I20260806 13:04:24.590997 2834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:04:24.591085 2867 mvcc.cc:205] Tried to move back new op lower bound from 7315543918945525760 to 7315543918936723456. Current Snapshot: MvccSnapshot[applied={T|T < 7315543918945525760}]
I20260806 13:04:24.591159 2866 mvcc.cc:205] Tried to move back new op lower bound from 7315543918945525760 to 7315543918936723456. Current Snapshot: MvccSnapshot[applied={T|T < 7315543918945525760}]
I20260806 13:04:24.591718 2864 catalog_manager.cc:1347] Generated new cluster ID: 208c02d067ed4073856319c5804ad38f
I20260806 13:04:24.591782 2864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:04:24.605922 2864 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:04:24.606655 2864 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:04:24.611644 2864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f526973e875246eaa3d0d332b00aa70a: Generated new TSK 0
I20260806 13:04:24.611986 2864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:04:25.350209 2845 catalog_manager.cc:1259] Loaded cluster ID: 208c02d067ed4073856319c5804ad38f
I20260806 13:04:25.350327 2845 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: loading cluster ID for follower catalog manager: success
I20260806 13:04:25.351315 2845 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: acquiring CA information for follower catalog manager: success
I20260806 13:04:25.351655 2845 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3d058a344e234182810e638ec3e989b5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 13:04:25.368490 2860 catalog_manager.cc:1259] Loaded cluster ID: 208c02d067ed4073856319c5804ad38f
I20260806 13:04:25.368654 2860 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: loading cluster ID for follower catalog manager: success
I20260806 13:04:25.369735 2860 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: acquiring CA information for follower catalog manager: success
I20260806 13:04:25.370155 2860 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1a48cf7c9a034a8abf8f811ae658d20d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 13:04:25.689225 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 2582
I20260806 13:04:25.696933 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 2659
I20260806 13:04:25.704583 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 2736
2026-08-06T13:04:25Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3220 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:04:25 dist-test-slave-srgv krb5kdc[2880](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:04:25 dist-test-slave-srgv krb5kdc[2880](info): set up 2 sockets
Aug 06 13:04:25 dist-test-slave-srgv krb5kdc[2880](info): commencing operation
krb5kdc: starting...
W20260806 13:04:26.834316 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:04:26 dist-test-slave-srgv krb5kdc[2880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:04:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:04:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:04:26.987996 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43481
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:43481
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:27.087559 2893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:27.087955 2893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:27.088011 2893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:27.089764 2893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:27.089890 2893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:27.089918 2893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:27.089938 2893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:27.089959 2893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:27.092231 2893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:43481
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:43481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:27.093012 2893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:27.093395 2893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:27.100251 2899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:27.100258 2901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:27.100258 2898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:27.100647 2893 server_base.cc:1034] running on GCE node
I20260806 13:04:27.101083 2893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:27.101533 2893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:27.102725 2893 hybrid_clock.cc:648] HybridClock initialized: now 1786021467102714 us; error 60 us; skew 500 ppm
Aug 06 13:04:27 dist-test-slave-srgv krb5kdc[2880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021467, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:27.106526 2893 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:04:27.107291 2893 webserver.cc:460] Webserver started at http://127.20.245.190:45509/ using document root <none> and password file <none>
I20260806 13:04:27.107605 2893 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:27.107681 2893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:27.107872 2893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:27.109337 2893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d"
format_stamp: "Formatted at 2026-08-06 13:04:27 on dist-test-slave-srgv"
server_key: "a36f01f8700849562c1903fe4e0ca0fb"
server_key_iv: "8162f7f0c355f1b20e83f937ff30332b"
server_key_version: "encryptionkey@0"
I20260806 13:04:27.109838 2893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d"
format_stamp: "Formatted at 2026-08-06 13:04:27 on dist-test-slave-srgv"
server_key: "a36f01f8700849562c1903fe4e0ca0fb"
server_key_iv: "8162f7f0c355f1b20e83f937ff30332b"
server_key_version: "encryptionkey@0"
I20260806 13:04:27.111761 2893 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 13:04:27.112919 2908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:27.113349 2893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:04:27.113512 2893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d"
format_stamp: "Formatted at 2026-08-06 13:04:27 on dist-test-slave-srgv"
server_key: "a36f01f8700849562c1903fe4e0ca0fb"
server_key_iv: "8162f7f0c355f1b20e83f937ff30332b"
server_key_version: "encryptionkey@0"
I20260806 13:04:27.113626 2893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:27.137086 2893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:27.140411 2893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:27.140645 2893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:27.146541 2893 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:43481
I20260806 13:04:27.146590 2962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:43481 every 8 connection(s)
I20260806 13:04:27.147089 2893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:04:27.148329 2963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:27.151506 2963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d: Bootstrap starting.
I20260806 13:04:27.152278 2963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:27.152606 2963 log.cc:824] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:27.153635 2963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d: No bootstrap required, opened a new log
I20260806 13:04:27.155900 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 2893
I20260806 13:04:27.156031 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:04:27.156122 2963 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43481 } }
I20260806 13:04:27.156378 21462 external_mini_cluster.cc:1428] Setting key 89452bd25a22637c063329d464268ad1
I20260806 13:04:27.156384 2963 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:27.156445 2963 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1cba7ed2b5b4c2c8013a3dd6ba2677d, State: Initialized, Role: FOLLOWER
I20260806 13:04:27.156688 2963 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43481 } }
I20260806 13:04:27.156816 2963 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:04:27.156868 2963 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:04:27.156932 2963 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:27.157955 2963 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43481 } }
I20260806 13:04:27.158109 2963 leader_election.cc:302] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1cba7ed2b5b4c2c8013a3dd6ba2677d; no voters:
I20260806 13:04:27.158427 2963 leader_election.cc:288] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:04:27.158452 2968 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:27.158653 2968 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [term 1 LEADER]: Becoming Leader. State: Replica: c1cba7ed2b5b4c2c8013a3dd6ba2677d, State: Running, Role: LEADER
I20260806 13:04:27.158833 2963 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:27.158844 2968 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43481 } }
I20260806 13:04:27.160393 2969 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43481 } } }
I20260806 13:04:27.160511 2969 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:27.160909 2970 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1cba7ed2b5b4c2c8013a3dd6ba2677d. Latest consensus state: current_term: 1 leader_uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1cba7ed2b5b4c2c8013a3dd6ba2677d" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 43481 } } }
I20260806 13:04:27.160995 2970 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d [sys.catalog]: This master's current role is: LEADER
W20260806 13:04:27.161268 2983 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:04:27.161341 2983 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:04:27.161451 2984 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:04:27.161655 2984 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:04:27.164224 2984 catalog_manager.cc:1347] Generated new cluster ID: 055bb612dfe44d8bba9f579205cfd7f5
I20260806 13:04:27.164309 2984 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:04:27 dist-test-slave-srgv krb5kdc[2880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:27.172869 2967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:27.157182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50034 (local address 127.20.245.190:43481)
0806 13:04:27.157425 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:27.157437 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:27.157474 (+ 37us) server_negotiation.cc:407] Connection header received
0806 13:04:27.157918 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:27.157927 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:27.157995 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:27.158235 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:27.159232 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:27.161013 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:27.162394 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:27.163131 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:27.163340 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:27.167133 (+ 3793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:27.167141 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:27.167141 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:27.167162 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:27.170461 (+ 3299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:27.171101 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:27.171105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:27.171106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:27.171315 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:27.171572 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:27.171573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:27.171573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:27.171964 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:27.172137 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:27.172410 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 13:04:27.172586 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":135,"threads_started":1}
I20260806 13:04:27.174247 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:04:27.185838 2984 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:04:27.186604 2984 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:04:27.194552 2984 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1cba7ed2b5b4c2c8013a3dd6ba2677d: Generated new TSK 0
I20260806 13:04:27.194902 2984 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:04:27.229732 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 2893
2026-08-06T13:04:27Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1523 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:04:27 dist-test-slave-srgv krb5kdc[2990](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:04:27 dist-test-slave-srgv krb5kdc[2990](info): set up 2 sockets
Aug 06 13:04:27 dist-test-slave-srgv krb5kdc[2990](info): commencing operation
krb5kdc: starting...
W20260806 13:04:28.303711 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:04:28 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:04:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:04:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:04:28.451489 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33541
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:33541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:28.552559 3004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:28.552893 3004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:28.552942 3004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:28.554437 3004 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:28.554522 3004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:28.554550 3004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:28.554590 3004 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:28.554639 3004 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:28.556670 3004 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:33541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:28.557047 3004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:28.557391 3004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:28.563905 3009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:28.563897 3012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:28.563934 3004 server_base.cc:1034] running on GCE node
W20260806 13:04:28.563897 3010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:28.564472 3004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:28.564845 3004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:28.566004 3004 hybrid_clock.cc:648] HybridClock initialized: now 1786021468565981 us; error 43 us; skew 500 ppm
Aug 06 13:04:28 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021468, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:28.577852 3004 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:04:28.578460 3004 webserver.cc:460] Webserver started at http://127.20.245.190:46183/ using document root <none> and password file <none>
I20260806 13:04:28.578838 3004 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:28.578902 3004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:28.579089 3004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:28.580579 3004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "04e2d42416534ba1bf81febca244f083"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "cc25cbf6cae8b0634c342fd7aa7c25d4"
server_key_iv: "27936193cb1a33797351dcf74d8ff16c"
server_key_version: "encryptionkey@0"
I20260806 13:04:28.581044 3004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "04e2d42416534ba1bf81febca244f083"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "cc25cbf6cae8b0634c342fd7aa7c25d4"
server_key_iv: "27936193cb1a33797351dcf74d8ff16c"
server_key_version: "encryptionkey@0"
I20260806 13:04:28.582873 3004 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:04:28.584461 3019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:28.584765 3004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:28.584889 3004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "04e2d42416534ba1bf81febca244f083"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "cc25cbf6cae8b0634c342fd7aa7c25d4"
server_key_iv: "27936193cb1a33797351dcf74d8ff16c"
server_key_version: "encryptionkey@0"
I20260806 13:04:28.584980 3004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:28.609356 3004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:28.612627 3004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:28.612804 3004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:28.618733 3004 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:33541
I20260806 13:04:28.618770 3072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:33541 every 8 connection(s)
I20260806 13:04:28.619421 3004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:04:28.620834 3073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:28.624063 3073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Bootstrap starting.
I20260806 13:04:28.624841 3073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:28.625200 3073 log.cc:824] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:28.626200 3073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: No bootstrap required, opened a new log
I20260806 13:04:28.628222 3073 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:28.628432 3073 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:28.628484 3073 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e2d42416534ba1bf81febca244f083, State: Initialized, Role: FOLLOWER
I20260806 13:04:28.628711 3073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:28.628825 3073 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:04:28.628875 3073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:04:28.628933 3073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:28.629688 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 3004
I20260806 13:04:28.629848 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:04:28.630103 21462 external_mini_cluster.cc:1428] Setting key e60fe1dce0c29a49661e05fd80560ffe
I20260806 13:04:28.630405 3073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:28.630545 3073 leader_election.cc:302] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04e2d42416534ba1bf81febca244f083; no voters:
I20260806 13:04:28.631019 3073 leader_election.cc:288] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:04:28.631069 3078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:28.631269 3078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 1 LEADER]: Becoming Leader. State: Replica: 04e2d42416534ba1bf81febca244f083, State: Running, Role: LEADER
I20260806 13:04:28.631402 3073 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:28.631438 3078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:28.631968 3079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04e2d42416534ba1bf81febca244f083" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } } }
I20260806 13:04:28.632058 3079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:28.632339 3080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e2d42416534ba1bf81febca244f083. Latest consensus state: current_term: 1 leader_uuid: "04e2d42416534ba1bf81febca244f083" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } } }
I20260806 13:04:28.632735 3080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:28.633030 3085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:04:28.633647 3085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:04:28.636593 3085 catalog_manager.cc:1347] Generated new cluster ID: 2def6be2e8964009a96bb82b0d444465
I20260806 13:04:28.636658 3085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:04:28 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:28.643970 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:28.630741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40518 (local address 127.20.245.190:33541)
0806 13:04:28.630974 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:28.630987 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:28.631033 (+ 46us) server_negotiation.cc:407] Connection header received
0806 13:04:28.631231 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:28.631242 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:28.631318 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:28.632513 (+ 1195us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:28.632660 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:28.634157 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:28.635542 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:28.636166 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:28.636323 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:28.639596 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:28.639603 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:28.639603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:28.639621 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:28.641829 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:28.642304 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:28.642308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:28.642309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:28.642444 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:28.642665 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:28.642666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:28.642667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:28.643035 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:28.643286 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:28.643535 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 13:04:28.643697 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":126,"threads_started":1}
I20260806 13:04:28.655666 3085 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:04:28.656327 3085 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:04:28.661747 3085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Generated new TSK 0
I20260806 13:04:28.662055 3085 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:04:28.707129 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33541
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:28.810616 3099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:28.811022 3099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:28.811074 3099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:28.812901 3099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:28.813006 3099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:28.813043 3099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:04:28.814932 3099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:28.815286 3099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:28.815544 3099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:28.822005 3106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:28.821977 3108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:28.821977 3105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:28.822228 3099 server_base.cc:1034] running on GCE node
I20260806 13:04:28.822660 3099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:28.823005 3099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:28.824190 3099 hybrid_clock.cc:648] HybridClock initialized: now 1786021468824168 us; error 45 us; skew 500 ppm
Aug 06 13:04:28 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021468, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:28.827764 3099 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:04:28.828327 3099 webserver.cc:460] Webserver started at http://127.20.245.129:43001/ using document root <none> and password file <none>
I20260806 13:04:28.828620 3099 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:28.828675 3099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:28.828802 3099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:28.830168 3099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "e5571eedce1d494d8e20c25f80460c23"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "8493c13c0ccd5bd94ae6349f276f33dc"
server_key_iv: "283cbd92b9056d4dc843dcda238633f4"
server_key_version: "encryptionkey@0"
I20260806 13:04:28.830564 3099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "e5571eedce1d494d8e20c25f80460c23"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "8493c13c0ccd5bd94ae6349f276f33dc"
server_key_iv: "283cbd92b9056d4dc843dcda238633f4"
server_key_version: "encryptionkey@0"
I20260806 13:04:28.832484 3099 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 13:04:28.833525 3115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:28.833732 3099 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:28.833848 3099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "e5571eedce1d494d8e20c25f80460c23"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "8493c13c0ccd5bd94ae6349f276f33dc"
server_key_iv: "283cbd92b9056d4dc843dcda238633f4"
server_key_version: "encryptionkey@0"
I20260806 13:04:28.833940 3099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:28.848780 3099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:28.851688 3099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:28.851886 3099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:28.852195 3099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:28.852569 3099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:28.852623 3099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:28.852669 3099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:28.852691 3099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:28.859958 3099 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:39579
I20260806 13:04:28.860018 3229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:39579 every 8 connection(s)
I20260806 13:04:28.860458 3099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:04:28.864830 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 3099
I20260806 13:04:28.864984 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:04:28.865244 21462 external_mini_cluster.cc:1428] Setting key aeb9eb1626e771f360cc1eb50d4519f6
Aug 06 13:04:28 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021468, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:28.875145 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:28.861627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:54463 (local address 127.20.245.190:33541)
0806 13:04:28.861731 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:28.861735 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:28.862015 (+ 280us) server_negotiation.cc:407] Connection header received
0806 13:04:28.862740 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:28.862742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:28.862761 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:28.862833 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:28.864362 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:28.865384 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:28.866837 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:28.867238 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:28.867327 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:28.870408 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:28.870410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:28.870411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:28.870423 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:28.872544 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:28.873405 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:28.873409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:28.873410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:28.873513 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:28.873925 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:28.873926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:28.873927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:28.874165 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:28.874275 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:28.874867 (+ 592us) server_negotiation.cc:299] Negotiation successful
0806 13:04:28.875020 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 13:04:28.875541 3232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:28.861571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:54463)
0806 13:04:28.861846 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:28.861894 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:28.862565 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:28.862920 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:28.862924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:28.863881 (+ 957us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:28.864158 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:28.864164 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:28.865507 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:28.865509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:28.866713 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:28.866717 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:28.867348 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:28.867349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:28.867498 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:28.868227 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:28.868244 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:28.870270 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:28.872807 (+ 2537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:28.872822 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:28.872825 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:28.873192 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:28.873659 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:28.873659 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:28.873660 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:28.873843 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:28.874446 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:28.874456 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:28.874664 (+ 208us) client_negotiation.cc:769] Sending connection context
0806 13:04:28.874804 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 13:04:28.875011 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":139,"threads_started":1}
I20260806 13:04:28.876356 3230 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33541
I20260806 13:04:28.876536 3230 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:28.876869 3230 heartbeater.cc:511] Master 127.20.245.190:33541 requested a full tablet report, sending...
I20260806 13:04:28.877904 3036 ts_manager.cc:194] Registered new tserver with Master: e5571eedce1d494d8e20c25f80460c23 (127.20.245.129:39579)
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:04:28.878860 3036 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:54463
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:04:28.903605 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33541
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:29.008068 3235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:29.008404 3235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:29.008440 3235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:29.010161 3235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:29.010257 3235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:29.010299 3235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:04:29.012758 3235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:29.013131 3235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:29.013439 3235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:29.020035 3240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:29.020012 3243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:29.020010 3241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:29.020048 3235 server_base.cc:1034] running on GCE node
I20260806 13:04:29.020586 3235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:29.020911 3235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:29.022094 3235 hybrid_clock.cc:648] HybridClock initialized: now 1786021469022096 us; error 41 us; skew 500 ppm
Aug 06 13:04:29 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021469, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:29.025449 3235 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:04:29.026041 3235 webserver.cc:460] Webserver started at http://127.20.245.130:34635/ using document root <none> and password file <none>
I20260806 13:04:29.026343 3235 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:29.026417 3235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:29.026587 3235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:29.028030 3235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "2d60fa16395a44d1ad16ae02f749d2a2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "f7052a133647d5f336cc0303a058f446"
server_key_iv: "70401dac9fcfaaf5f94c6576e0ed7195"
server_key_version: "encryptionkey@0"
I20260806 13:04:29.028505 3235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "2d60fa16395a44d1ad16ae02f749d2a2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "f7052a133647d5f336cc0303a058f446"
server_key_iv: "70401dac9fcfaaf5f94c6576e0ed7195"
server_key_version: "encryptionkey@0"
I20260806 13:04:29.030330 3235 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:04:29.031500 3251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:29.031729 3235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:04:29.031847 3235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "2d60fa16395a44d1ad16ae02f749d2a2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "f7052a133647d5f336cc0303a058f446"
server_key_iv: "70401dac9fcfaaf5f94c6576e0ed7195"
server_key_version: "encryptionkey@0"
I20260806 13:04:29.031944 3235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:29.048712 3235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:29.051651 3235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:29.051935 3235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:29.052356 3235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:29.052790 3235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:29.052831 3235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:29.052857 3235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:29.052870 3235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:29.060144 3235 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:45913
I20260806 13:04:29.060182 3367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:45913 every 8 connection(s)
I20260806 13:04:29.060628 3235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:04:29.061638 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 3235
I20260806 13:04:29.061794 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:04:29.062094 21462 external_mini_cluster.cc:1428] Setting key dd2f00391c6dffd91ce629298a72de6c
Aug 06 13:04:29 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021469, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
I20260806 13:04:29.074654 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.061621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:47113 (local address 127.20.245.190:33541)
0806 13:04:29.061703 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.061706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.062047 (+ 341us) server_negotiation.cc:407] Connection header received
0806 13:04:29.062858 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.062859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.062875 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.062947 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:29.064738 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.065502 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.067325 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.067723 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.067799 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.071087 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:29.071090 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:29.071090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:29.071112 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:29.072843 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.073435 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.073436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.073437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.073512 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.073806 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.073807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.073807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.073973 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:29.074053 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.074404 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.074534 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 13:04:29.074923 3370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.061516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:47113)
0806 13:04:29.061844 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.061919 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.062719 (+ 800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.063055 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.063061 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.064170 (+ 1109us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:29.064571 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.064582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.065664 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.065665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.067154 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.067159 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.067825 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.067826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.068018 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.068803 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:29.068818 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:29.070933 (+ 2115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:29.072973 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:29.072986 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:29.072990 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:29.073282 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:29.073584 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:29.073585 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:29.073586 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:29.073736 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:29.074050 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:29.074060 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:29.074250 (+ 190us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.074372 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.074608 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":109,"threads_started":1}
I20260806 13:04:29.075635 3368 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33541
I20260806 13:04:29.075824 3368 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:29.076113 3368 heartbeater.cc:511] Master 127.20.245.190:33541 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
I20260806 13:04:29.076761 3036 ts_manager.cc:194] Registered new tserver with Master: 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
I20260806 13:04:29.077481 3036 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:47113
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:04:29.095067 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33541
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:29.190233 3373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:29.190574 3373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:29.190621 3373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:29.192247 3373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:29.192344 3373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:29.192405 3373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:04:29.194379 3373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:29.194753 3373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:29.195048 3373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:29.201560 3378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:29.201668 3373 server_base.cc:1034] running on GCE node
W20260806 13:04:29.201560 3379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:29.201560 3381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:29.202121 3373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:29.202441 3373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:29.203614 3373 hybrid_clock.cc:648] HybridClock initialized: now 1786021469203569 us; error 61 us; skew 500 ppm
Aug 06 13:04:29 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021469, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:29.207263 3373 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:04:29.207954 3373 webserver.cc:460] Webserver started at http://127.20.245.131:43269/ using document root <none> and password file <none>
I20260806 13:04:29.208249 3373 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:29.208310 3373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:29.208473 3373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:29.209897 3373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "e900f5f401f0499f9d41c96330db44e2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "090a5cb7fe64d28c210f39e698445f6d"
server_key_iv: "ea23fe5b3e924cad56aa6e9331423802"
server_key_version: "encryptionkey@0"
I20260806 13:04:29.210369 3373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "e900f5f401f0499f9d41c96330db44e2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "090a5cb7fe64d28c210f39e698445f6d"
server_key_iv: "ea23fe5b3e924cad56aa6e9331423802"
server_key_version: "encryptionkey@0"
I20260806 13:04:29.212258 3373 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 13:04:29.213307 3388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:29.213553 3373 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:29.213668 3373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "e900f5f401f0499f9d41c96330db44e2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "090a5cb7fe64d28c210f39e698445f6d"
server_key_iv: "ea23fe5b3e924cad56aa6e9331423802"
server_key_version: "encryptionkey@0"
I20260806 13:04:29.213762 3373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:29.224786 3373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:29.228020 3373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:29.228202 3373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:29.228541 3373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:29.229013 3373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:29.229070 3373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:29.229120 3373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:29.229164 3373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:29.237138 3373 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:35371
I20260806 13:04:29.237181 3505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:35371 every 8 connection(s)
I20260806 13:04:29.237695 3373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:04:29.242367 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 3373
I20260806 13:04:29.242478 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:04:29.242720 21462 external_mini_cluster.cc:1428] Setting key 2320769dd44ef8a60b2513ccb26e7547
Aug 06 13:04:29 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021469, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:29.250322 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.238629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:54333 (local address 127.20.245.190:33541)
0806 13:04:29.238726 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.238728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.238986 (+ 258us) server_negotiation.cc:407] Connection header received
0806 13:04:29.239720 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.239721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.239735 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.239809 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:29.241120 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.241718 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.243011 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.243409 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.243483 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.246447 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:29.246450 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:29.246451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:29.246462 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:29.248564 (+ 2102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.249195 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.249197 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.249197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.249266 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.249539 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.249540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.249540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.249688 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:29.249746 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.250086 (+ 340us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.250232 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:04:29.250566 3508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.238612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:54333)
0806 13:04:29.238820 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.238874 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.239594 (+ 720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.239945 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.239951 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.240692 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:29.240957 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.240963 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.241820 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.241821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.242906 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.242909 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.243512 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.243513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.243713 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.244520 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:29.244532 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:29.246287 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:29.248702 (+ 2415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:29.248716 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:29.248719 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:29.249052 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:29.249332 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:29.249332 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:29.249333 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:29.249483 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:29.249746 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:29.249752 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:29.249935 (+ 183us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.250049 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.250254 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":118,"threads_started":1}
I20260806 13:04:29.251374 3506 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33541
I20260806 13:04:29.251544 3506 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:29.251904 3506 heartbeater.cc:511] Master 127.20.245.190:33541 requested a full tablet report, sending...
I20260806 13:04:29.253422 3036 ts_manager.cc:194] Registered new tserver with Master: e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371)
I20260806 13:04:29.254185 3036 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:54333
I20260806 13:04:29.255381 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:04:29.265443 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.257238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40520 (local address 127.20.245.190:33541)
0806 13:04:29.257331 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.257334 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.257526 (+ 192us) server_negotiation.cc:407] Connection header received
0806 13:04:29.257561 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.257562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.257573 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.257662 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:29.258406 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.258976 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.260002 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.260267 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.260346 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.262037 (+ 1691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:29.262039 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:29.262040 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:29.262050 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:29.264010 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.264507 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.264508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.264509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.264584 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.264803 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.264805 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.264805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.265027 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:29.265144 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.265276 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.265355 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 13:04:29.267757 3036 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40520:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:04:29.269914 3036 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:04:29.278015 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.273183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.20.245.129:39579)
0806 13:04:29.273442 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.273449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.273563 (+ 114us) server_negotiation.cc:407] Connection header received
0806 13:04:29.273706 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.273708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.273730 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.274087 (+ 357us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:29.274195 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.275408 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.276963 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.277518 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.277615 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.277679 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.277824 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.277879 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":114,"threads_started":1}
I20260806 13:04:29.278000 3521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.272933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39579 (local address 127.0.0.1:53614)
0806 13:04:29.273496 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.273507 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.273593 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.273860 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.273864 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.273868 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:29.273991 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.273993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.275551 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.275552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.276844 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.276848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.277626 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.277627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.277724 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.277729 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.277791 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.277893 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":34,"thread_start_us":137,"threads_started":1}
I20260806 13:04:29.278422 3517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.273186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:35371 (local address 127.0.0.1:55150)
0806 13:04:29.273854 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.273864 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.273915 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.274151 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.274152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.274154 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:29.274194 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.274196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.275536 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.275537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.276846 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.276848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.278166 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.278168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.278242 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.278247 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.278306 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.278352 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":86,"thread_start_us":142,"threads_started":1}
I20260806 13:04:29.278750 3523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.273457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55942 (local address 127.20.245.130:45913)
0806 13:04:29.273669 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.273674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.273687 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:04:29.273735 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.273737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.273756 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.273840 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:29.274079 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.274941 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.276588 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.277327 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.277414 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.277486 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.278554 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.278633 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":115,"threads_started":1}
I20260806 13:04:29.279101 3164 tablet_service.cc:1467] Processing CreateTablet for tablet 40b6c89cb7a944418625892f54c493b3 (DEFAULT_TABLE table=test-table [id=9620cb1070ac497d8c1e3344f2a2d5ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:29.279601 3164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b6c89cb7a944418625892f54c493b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:29.279747 3522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.273343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.20.245.131:35371)
0806 13:04:29.273807 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.273811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.273975 (+ 164us) server_negotiation.cc:407] Connection header received
0806 13:04:29.274024 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.274026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.274047 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.274131 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:29.274264 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.275416 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.276944 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.277715 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.277804 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.277860 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.279539 (+ 1679us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.279620 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":135,"threads_started":1}
I20260806 13:04:29.279906 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.272924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45913 (local address 127.0.0.1:55942)
0806 13:04:29.273140 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.273205 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.273293 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.273906 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.273907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.273910 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:29.273984 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.273987 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.275059 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.275061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.276486 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.276490 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.277530 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.277531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.277672 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.277695 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.277787 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.277894 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":96,"thread_start_us":84,"threads_started":1}
I20260806 13:04:29.280622 3437 tablet_service.cc:1467] Processing CreateTablet for tablet 40b6c89cb7a944418625892f54c493b3 (DEFAULT_TABLE table=test-table [id=9620cb1070ac497d8c1e3344f2a2d5ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:29.280856 3299 tablet_service.cc:1467] Processing CreateTablet for tablet 40b6c89cb7a944418625892f54c493b3 (DEFAULT_TABLE table=test-table [id=9620cb1070ac497d8c1e3344f2a2d5ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:29.281038 3437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b6c89cb7a944418625892f54c493b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:29.281296 3299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b6c89cb7a944418625892f54c493b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:29.284466 3525 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Bootstrap starting.
I20260806 13:04:29.285184 3525 tablet_bootstrap.cc:654] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:29.285576 3526 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Bootstrap starting.
I20260806 13:04:29.285924 3525 log.cc:824] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:29.286295 3526 tablet_bootstrap.cc:654] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:29.286334 3524 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Bootstrap starting.
I20260806 13:04:29.286917 3526 log.cc:824] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:29.287000 3524 tablet_bootstrap.cc:654] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:29.287726 3524 log.cc:824] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:29.287969 3526 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: No bootstrap required, opened a new log
I20260806 13:04:29.288065 3526 ts_tablet_manager.cc:1397] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 13:04:29.288430 3525 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: No bootstrap required, opened a new log
I20260806 13:04:29.288514 3525 ts_tablet_manager.cc:1397] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 13:04:29.288686 3524 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: No bootstrap required, opened a new log
I20260806 13:04:29.288765 3524 ts_tablet_manager.cc:1397] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 13:04:29.290375 3525 raft_consensus.cc:348] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.290588 3525 raft_consensus.cc:374] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:29.290637 3525 raft_consensus.cc:729] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e900f5f401f0499f9d41c96330db44e2, State: Initialized, Role: FOLLOWER
I20260806 13:04:29.290623 3526 raft_consensus.cc:348] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.290814 3526 raft_consensus.cc:374] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:29.290869 3526 raft_consensus.cc:729] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d60fa16395a44d1ad16ae02f749d2a2, State: Initialized, Role: FOLLOWER
I20260806 13:04:29.290819 3525 consensus_queue.cc:260] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.291044 3526 consensus_queue.cc:260] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.291258 3525 ts_tablet_manager.cc:1428] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:04:29.291424 3506 heartbeater.cc:503] Master 127.20.245.190:33541 was elected leader, sending a full tablet report...
I20260806 13:04:29.291309 3524 raft_consensus.cc:348] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.291472 3524 raft_consensus.cc:374] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:29.291481 3368 heartbeater.cc:503] Master 127.20.245.190:33541 was elected leader, sending a full tablet report...
I20260806 13:04:29.291510 3524 raft_consensus.cc:729] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5571eedce1d494d8e20c25f80460c23, State: Initialized, Role: FOLLOWER
I20260806 13:04:29.291661 3524 consensus_queue.cc:260] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.291960 3524 ts_tablet_manager.cc:1428] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260806 13:04:29.292097 3230 heartbeater.cc:503] Master 127.20.245.190:33541 was elected leader, sending a full tablet report...
I20260806 13:04:29.292725 3526 ts_tablet_manager.cc:1428] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
W20260806 13:04:29.311506 3369 tablet.cc:2369] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:04:29.361449 3231 tablet.cc:2369] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:04:29.453444 3532 raft_consensus.cc:482] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:29.453671 3532 raft_consensus.cc:504] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.454198 3532 leader_election.cc:288] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913), e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371)
I20260806 13:04:29.455386 3530 raft_consensus.cc:482] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:29.455559 3530 raft_consensus.cc:504] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.456144 3530 leader_election.cc:288] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913), e5571eedce1d494d8e20c25f80460c23 (127.20.245.129:39579)
I20260806 13:04:29.459053 3523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.454626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:60159 (local address 127.20.245.130:45913)
0806 13:04:29.454720 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.454723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.454740 (+ 17us) server_negotiation.cc:407] Connection header received
0806 13:04:29.454889 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.454891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.454909 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.455000 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:29.455289 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.456161 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.457973 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.458583 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.458636 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.458648 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.458913 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.458962 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 13:04:29.459050 3522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.454972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:57197 (local address 127.20.245.131:35371)
0806 13:04:29.455046 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.455049 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.455059 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:04:29.455149 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.455150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.455160 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.455236 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:29.455491 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.456240 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.457903 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.458577 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.458636 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.458648 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.458913 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.458962 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:04:29.459398 3535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.454820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:35371 (local address 127.20.245.129:57197)
0806 13:04:29.454985 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.454999 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.455076 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.455280 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.455281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.455284 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:29.455394 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.455397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.456331 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.456331 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.457775 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.457779 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.458723 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.458723 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.458819 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.458826 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.459206 (+ 380us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.459274 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":15,"thread_start_us":100,"threads_started":1}
I20260806 13:04:29.459666 3534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.454484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45913 (local address 127.20.245.129:60159)
0806 13:04:29.454658 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.454674 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.454756 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.455021 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.455022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.455025 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:29.455150 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.455153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.456320 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.456321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.457881 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.457883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.458721 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.458722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.458819 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.458826 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.459199 (+ 373us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.459273 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":376,"spinlock_wait_cycles":1408,"thread_start_us":140,"threads_started":1}
I20260806 13:04:29.459834 3458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b6c89cb7a944418625892f54c493b3" candidate_uuid: "e5571eedce1d494d8e20c25f80460c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e900f5f401f0499f9d41c96330db44e2" is_pre_election: true
I20260806 13:04:29.460031 3458 raft_consensus.cc:2454] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5571eedce1d494d8e20c25f80460c23 in term 0.
I20260806 13:04:29.460177 3319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b6c89cb7a944418625892f54c493b3" candidate_uuid: "e5571eedce1d494d8e20c25f80460c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" is_pre_election: true
I20260806 13:04:29.460374 3319 raft_consensus.cc:2454] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5571eedce1d494d8e20c25f80460c23 in term 0.
I20260806 13:04:29.460345 3116 leader_election.cc:302] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5571eedce1d494d8e20c25f80460c23, e900f5f401f0499f9d41c96330db44e2; no voters:
I20260806 13:04:29.460512 3532 raft_consensus.cc:2781] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:04:29.460567 3532 raft_consensus.cc:482] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:04:29.460609 3532 raft_consensus.cc:3037] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:29.461306 3508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.456333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45913 (local address 127.20.245.131:46625)
0806 13:04:29.456483 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.456498 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.456542 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.457075 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.457076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.457078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:29.457154 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.457155 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.458283 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.458284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.459757 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.459762 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.461012 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.461013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.461102 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.461107 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.461171 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.461228 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":6}
I20260806 13:04:29.461362 3537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.456656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:46625 (local address 127.20.245.130:45913)
0806 13:04:29.456911 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.456913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.456922 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:04:29.456951 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.456952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.456965 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.457250 (+ 285us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:29.457314 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.458181 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.460010 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.460931 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.461016 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.461025 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.461204 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.461262 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":148,"threads_started":1}
I20260806 13:04:29.461678 3319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b6c89cb7a944418625892f54c493b3" candidate_uuid: "e900f5f401f0499f9d41c96330db44e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" is_pre_election: true
I20260806 13:04:29.461781 3319 raft_consensus.cc:2454] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e900f5f401f0499f9d41c96330db44e2 in term 0.
I20260806 13:04:29.461792 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.456578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:50217 (local address 127.20.245.129:39579)
0806 13:04:29.456652 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.456654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.456818 (+ 164us) server_negotiation.cc:407] Connection header received
0806 13:04:29.456917 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.456918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.456933 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.456967 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:29.457250 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.458071 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.460342 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.460965 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.461015 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.461024 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.461651 (+ 627us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.461706 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 13:04:29.461977 3532 raft_consensus.cc:504] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.462074 3536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.456364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39579 (local address 127.20.245.131:50217)
0806 13:04:29.456736 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.456745 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.456826 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.457046 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.457047 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.457049 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:29.457142 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.457145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.458196 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.458197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.460209 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.460212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.461447 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.461448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.461542 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.461549 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.461916 (+ 367us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.461980 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":56,"thread_start_us":109,"threads_started":1}
I20260806 13:04:29.462042 3389 leader_election.cc:302] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d60fa16395a44d1ad16ae02f749d2a2, e900f5f401f0499f9d41c96330db44e2; no voters:
I20260806 13:04:29.462167 3532 leader_election.cc:288] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 1 election: Requested vote from peers 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913), e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371)
I20260806 13:04:29.462267 3530 raft_consensus.cc:2781] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:04:29.462355 3530 raft_consensus.cc:482] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:04:29.462383 3530 raft_consensus.cc:3037] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:29.462383 3319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b6c89cb7a944418625892f54c493b3" candidate_uuid: "e5571eedce1d494d8e20c25f80460c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d60fa16395a44d1ad16ae02f749d2a2"
I20260806 13:04:29.462396 3184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b6c89cb7a944418625892f54c493b3" candidate_uuid: "e900f5f401f0499f9d41c96330db44e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5571eedce1d494d8e20c25f80460c23" is_pre_election: true
I20260806 13:04:29.462452 3458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b6c89cb7a944418625892f54c493b3" candidate_uuid: "e5571eedce1d494d8e20c25f80460c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e900f5f401f0499f9d41c96330db44e2"
I20260806 13:04:29.462510 3184 raft_consensus.cc:2379] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e900f5f401f0499f9d41c96330db44e2 in current term 1: Already voted for candidate e5571eedce1d494d8e20c25f80460c23 in this term.
I20260806 13:04:29.462476 3319 raft_consensus.cc:3037] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:29.463419 3530 raft_consensus.cc:504] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.463604 3530 leader_election.cc:288] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [CANDIDATE]: Term 1 election: Requested vote from peers 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913), e5571eedce1d494d8e20c25f80460c23 (127.20.245.129:39579)
I20260806 13:04:29.463617 3319 raft_consensus.cc:2454] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5571eedce1d494d8e20c25f80460c23 in term 1.
I20260806 13:04:29.463617 3458 raft_consensus.cc:2379] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e5571eedce1d494d8e20c25f80460c23 in current term 1: Already voted for candidate e900f5f401f0499f9d41c96330db44e2 in this term.
I20260806 13:04:29.463827 3184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b6c89cb7a944418625892f54c493b3" candidate_uuid: "e900f5f401f0499f9d41c96330db44e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5571eedce1d494d8e20c25f80460c23"
I20260806 13:04:29.463936 3184 raft_consensus.cc:2379] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e900f5f401f0499f9d41c96330db44e2 in current term 1: Already voted for candidate e5571eedce1d494d8e20c25f80460c23 in this term.
I20260806 13:04:29.463950 3319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b6c89cb7a944418625892f54c493b3" candidate_uuid: "e900f5f401f0499f9d41c96330db44e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d60fa16395a44d1ad16ae02f749d2a2"
I20260806 13:04:29.464066 3319 raft_consensus.cc:2379] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e900f5f401f0499f9d41c96330db44e2 in current term 1: Already voted for candidate e5571eedce1d494d8e20c25f80460c23 in this term.
I20260806 13:04:29.463855 3116 leader_election.cc:302] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d60fa16395a44d1ad16ae02f749d2a2, e5571eedce1d494d8e20c25f80460c23; no voters:
I20260806 13:04:29.464275 3532 raft_consensus.cc:2781] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:29.464278 3389 leader_election.cc:302] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e900f5f401f0499f9d41c96330db44e2; no voters: 2d60fa16395a44d1ad16ae02f749d2a2, e5571eedce1d494d8e20c25f80460c23
I20260806 13:04:29.464375 3530 raft_consensus.cc:2726] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 13:04:29.464504 3532 raft_consensus.cc:686] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 LEADER]: Becoming Leader. State: Replica: e5571eedce1d494d8e20c25f80460c23, State: Running, Role: LEADER
I20260806 13:04:29.464627 3532 consensus_queue.cc:237] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.465780 3034 catalog_manager.cc:5495] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5571eedce1d494d8e20c25f80460c23 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "e5571eedce1d494d8e20c25f80460c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } health_report { overall_health: UNKNOWN } } }
W20260806 13:04:29.488608 3507 tablet.cc:2369] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:04:29.513013 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.510054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53616 (local address 127.20.245.129:39579)
0806 13:04:29.510110 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.510112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.510119 (+ 7us) server_negotiation.cc:407] Connection header received
0806 13:04:29.510173 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.510174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.510201 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.510288 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:04:29.510515 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.511077 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.512043 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.512315 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.512383 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.512583 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:04:29.512735 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:04:29.512809 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.512836 (+ 27us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.512860 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 13:04:29.515858 3319 raft_consensus.cc:1261] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Refusing update from remote peer e5571eedce1d494d8e20c25f80460c23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:29.515858 3458 raft_consensus.cc:1261] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Refusing update from remote peer e5571eedce1d494d8e20c25f80460c23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:29.516247 3532 consensus_queue.cc:1035] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:29.516454 3538 consensus_queue.cc:1035] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:29.520274 3542 mvcc.cc:205] Tried to move back new op lower bound from 7315543939132641280 to 7315543938927710208. Current Snapshot: MvccSnapshot[applied={T|T < 7315543939132641280}]
I20260806 13:04:29.523146 3036 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:04:29.523320 3036 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:04:29.524477 3036 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Sending DeleteTablet for 3 replicas of tablet 40b6c89cb7a944418625892f54c493b3
I20260806 13:04:29.525089 3437 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b6c89cb7a944418625892f54c493b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:29 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:55150
I20260806 13:04:29.525159 3299 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b6c89cb7a944418625892f54c493b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:29 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:55942
I20260806 13:04:29.525595 3164 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b6c89cb7a944418625892f54c493b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:29 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:53614
I20260806 13:04:29.525655 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 3099
I20260806 13:04:29.525676 3551 tablet_replica.cc:330] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: stopping tablet replica
I20260806 13:04:29.525815 3551 raft_consensus.cc:2229] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:29.525979 3551 raft_consensus.cc:2258] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:29.528002 3551 ts_tablet_manager.cc:1905] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:04:29.528369 3552 tablet_replica.cc:330] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: stopping tablet replica
I20260806 13:04:29.528522 3552 raft_consensus.cc:2229] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:29.528668 3552 raft_consensus.cc:2258] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:29.530296 3551 ts_tablet_manager.cc:1918] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:04:29.530390 3551 log.cc:1196] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/40b6c89cb7a944418625892f54c493b3
I20260806 13:04:29.530803 3551 ts_tablet_manager.cc:1939] T 40b6c89cb7a944418625892f54c493b3 P e900f5f401f0499f9d41c96330db44e2: Deleting consensus metadata
I20260806 13:04:29.531204 3552 ts_tablet_manager.cc:1905] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:04:29.531543 3020 catalog_manager.cc:4841] TS e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371): tablet 40b6c89cb7a944418625892f54c493b3 (table test-table [id=9620cb1070ac497d8c1e3344f2a2d5ea]) successfully deleted
I20260806 13:04:29.533529 3552 ts_tablet_manager.cc:1918] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:04:29.533661 3552 log.cc:1196] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/40b6c89cb7a944418625892f54c493b3
I20260806 13:04:29.533974 3552 ts_tablet_manager.cc:1939] T 40b6c89cb7a944418625892f54c493b3 P 2d60fa16395a44d1ad16ae02f749d2a2: Deleting consensus metadata
I20260806 13:04:29.534600 3020 catalog_manager.cc:4841] TS 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913): tablet 40b6c89cb7a944418625892f54c493b3 (table test-table [id=9620cb1070ac497d8c1e3344f2a2d5ea]) successfully deleted
W20260806 13:04:29.535115 3021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:39579 (error 108)
I20260806 13:04:29.535427 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 3235
I20260806 13:04:29.536809 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.536591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39579 (local address 127.0.0.1:53628)
0806 13:04:29.536701 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.536764 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:39579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260806 13:04:29.537050 3021 catalog_manager.cc:4584] TS e5571eedce1d494d8e20c25f80460c23 (127.20.245.129:39579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 40b6c89cb7a944418625892f54c493b3: Network error: Client connection negotiation failed: client connection to 127.20.245.129:39579: connect: Connection refused (error 111)
I20260806 13:04:29.544879 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 3373
I20260806 13:04:29.552157 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 3004
I20260806 13:04:29.560328 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33541
--webserver_interface=127.20.245.190
--webserver_port=46183
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:33541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:29.674036 3554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:29.674356 3554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:29.674386 3554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:29.675935 3554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:29.675999 3554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:29.676014 3554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:29.676028 3554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:29.676088 3554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:29.678115 3554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:33541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:29.678509 3554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:29.678864 3554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:29.692118 3561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:29.692052 3563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:29.692052 3560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:29.692559 3554 server_base.cc:1034] running on GCE node
I20260806 13:04:29.692975 3554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:29.693411 3554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:29.694597 3554 hybrid_clock.cc:648] HybridClock initialized: now 1786021469694569 us; error 51 us; skew 500 ppm
Aug 06 13:04:29 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021469, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:29.698019 3554 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:04:29.698737 3554 webserver.cc:460] Webserver started at http://127.20.245.190:46183/ using document root <none> and password file <none>
I20260806 13:04:29.699090 3554 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:29.699227 3554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:29.701238 3554 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 13:04:29.702409 3570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:29.702698 3554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:04:29.702844 3554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "04e2d42416534ba1bf81febca244f083"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "cc25cbf6cae8b0634c342fd7aa7c25d4"
server_key_iv: "27936193cb1a33797351dcf74d8ff16c"
server_key_version: "encryptionkey@0"
I20260806 13:04:29.703501 3554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:29.712683 3554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:29.717146 3554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:29.717382 3554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:29.723110 3554 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:33541
I20260806 13:04:29.723140 3623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:33541 every 8 connection(s)
I20260806 13:04:29.723889 3554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:04:29.726051 3624 sys_catalog.cc:263] Verifying existing consensus state
I20260806 13:04:29.726889 3624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Bootstrap starting.
I20260806 13:04:29.729074 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 3554
I20260806 13:04:29.729493 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:39579
--local_ip_for_outbound_sockets=127.20.245.129
--tserver_master_addrs=127.20.245.190:33541
--webserver_port=43001
--webserver_interface=127.20.245.129
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:04:29.740563 3624 log.cc:824] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:29.743583 3624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:04:29.744077 3624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Bootstrap complete.
I20260806 13:04:29.747081 3624 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:29.747542 3624 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e2d42416534ba1bf81febca244f083, State: Initialized, Role: FOLLOWER
I20260806 13:04:29.747784 3624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:29.747869 3624 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:04:29.747946 3624 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:04:29.748004 3624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 1 FOLLOWER]: Advancing to term 2
I20260806 13:04:29.749483 3624 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:29.749629 3624 leader_election.cc:302] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04e2d42416534ba1bf81febca244f083; no voters:
I20260806 13:04:29.749928 3624 leader_election.cc:288] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 13:04:29.749982 3628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 13:04:29.750137 3628 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 2 LEADER]: Becoming Leader. State: Replica: 04e2d42416534ba1bf81febca244f083, State: Running, Role: LEADER
I20260806 13:04:29.750255 3628 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:29.750293 3624 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:29.750605 3628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e2d42416534ba1bf81febca244f083. Latest consensus state: current_term: 2 leader_uuid: "04e2d42416534ba1bf81febca244f083" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } } }
I20260806 13:04:29.750689 3628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:29.750613 3629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "04e2d42416534ba1bf81febca244f083" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } } }
I20260806 13:04:29.750741 3629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:29.751081 3632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:04:29.752413 3632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:04:29.752631 3632 catalog_manager.cc:1259] Loaded cluster ID: 2def6be2e8964009a96bb82b0d444465
I20260806 13:04:29.752876 3632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:04:29.753196 3632 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 13:04:29.757695 3632 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 13:04:29.761091 3632 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:04:29.761441 3632 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Loaded TSK: 0
I20260806 13:04:29.761695 3632 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 13:04:29.838904 3626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:29.839278 3626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:29.839347 3626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:29.840821 3626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:29.840950 3626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:29.841012 3626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:04:29.842875 3626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:39579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=43001
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:29.843281 3626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:29.843590 3626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:29.849882 3652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:29.849884 3655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:29.850203 3626 server_base.cc:1034] running on GCE node
W20260806 13:04:29.849884 3653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:29.850607 3626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:29.851006 3626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:29.852193 3626 hybrid_clock.cc:648] HybridClock initialized: now 1786021469852167 us; error 46 us; skew 500 ppm
Aug 06 13:04:29 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021469, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:29.856015 3626 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:04:29.856916 3626 webserver.cc:460] Webserver started at http://127.20.245.129:43001/ using document root <none> and password file <none>
I20260806 13:04:29.857275 3626 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:29.857460 3626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:29.859923 3626 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:04:29.860998 3662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:29.861299 3626 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:29.861428 3626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "e5571eedce1d494d8e20c25f80460c23"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "8493c13c0ccd5bd94ae6349f276f33dc"
server_key_iv: "283cbd92b9056d4dc843dcda238633f4"
server_key_version: "encryptionkey@0"
I20260806 13:04:29.862030 3626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:29.883277 3626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:29.886456 3626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:29.886691 3626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:29.887056 3626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:29.887789 3669 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 13:04:29.889621 3626 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 13:04:29.889691 3626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 13:04:29.889735 3626 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 13:04:29.890873 3626 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 13:04:29.890921 3626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 13:04:29.891038 3669 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Bootstrap starting.
I20260806 13:04:29.899513 3626 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:39579
I20260806 13:04:29.899899 3777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:39579 every 8 connection(s)
I20260806 13:04:29.900098 3626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:04:29.905298 3669 log.cc:824] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:29.908423 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 3626
I20260806 13:04:29.908855 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:45913
--local_ip_for_outbound_sockets=127.20.245.130
--tserver_master_addrs=127.20.245.190:33541
--webserver_port=34635
--webserver_interface=127.20.245.130
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:04:29.909605 3669 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:04:29.909989 3669 tablet_bootstrap.cc:492] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Bootstrap complete.
I20260806 13:04:29.911388 3669 ts_tablet_manager.cc:1397] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.011s
Aug 06 13:04:29 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021469, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:29.913342 3669 raft_consensus.cc:348] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.913820 3669 raft_consensus.cc:729] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5571eedce1d494d8e20c25f80460c23, State: Initialized, Role: FOLLOWER
I20260806 13:04:29.914040 3669 consensus_queue.cc:260] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } } peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } }
I20260806 13:04:29.914487 3669 ts_tablet_manager.cc:1428] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20260806 13:04:29.919458 3781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.901328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:36925 (local address 127.20.245.190:33541)
0806 13:04:29.901600 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.901614 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.903645 (+ 2031us) server_negotiation.cc:407] Connection header received
0806 13:04:29.904641 (+ 996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.904651 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.904755 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.904949 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:29.906098 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.907828 (+ 1730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.909793 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.910499 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.910607 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.914399 (+ 3792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:29.914407 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:29.914408 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:29.914426 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:29.916981 (+ 2555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.917596 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.917602 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.917602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.917750 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.918061 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.918062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.918062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.918429 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:29.918498 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.918972 (+ 474us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.919164 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":134,"threads_started":1}
I20260806 13:04:29.920068 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.901146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:36925)
0806 13:04:29.903352 (+ 2206us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.903434 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.904305 (+ 871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.905032 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.905040 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.905599 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:29.905929 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.905937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.907999 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.908001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.909639 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.909645 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.910804 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.910806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.910983 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.911823 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:29.911836 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:29.914208 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:29.917116 (+ 2908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:29.917126 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:29.917129 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:29.917469 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:29.917839 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:29.917839 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:29.917840 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:29.917983 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:29.918559 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:29.918581 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:29.918757 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.919612 (+ 855us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.919846 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2134,"thread_start_us":114,"threads_started":1}
I20260806 13:04:29.921294 3778 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33541
I20260806 13:04:29.921440 3778 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:29.921717 3778 heartbeater.cc:511] Master 127.20.245.190:33541 requested a full tablet report, sending...
I20260806 13:04:29.922883 3587 ts_manager.cc:194] Registered new tserver with Master: e5571eedce1d494d8e20c25f80460c23 (127.20.245.129:39579)
I20260806 13:04:29.924507 3587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:36925
I20260806 13:04:29.925863 3778 heartbeater.cc:503] Master 127.20.245.190:33541 was elected leader, sending a full tablet report...
Aug 06 13:04:29 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021469, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:04:29.934201 3786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.923924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39579 (local address 127.0.0.1:53636)
0806 13:04:29.924187 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:29.924241 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:29.924335 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:29.924567 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:29.924574 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:29.925135 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:29.925253 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.925259 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.926548 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.926550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.927257 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:29.927259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.927790 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.927791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:29.927877 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.928505 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:29.928511 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:29.930209 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:29.932528 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:29.932569 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:29.932572 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:29.932977 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:29.933255 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:29.933256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:29.933256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:29.933333 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:29.933696 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:29.933706 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:29.933778 (+ 72us) client_negotiation.cc:769] Sending connection context
0806 13:04:29.933892 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 13:04:29.934072 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":182,"threads_started":1}
I20260806 13:04:29.934198 3787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:29.923999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53636 (local address 127.20.245.129:39579)
0806 13:04:29.924374 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:29.924380 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:29.924406 (+ 26us) server_negotiation.cc:407] Connection header received
0806 13:04:29.924448 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:29.924451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:29.924467 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:29.924562 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:29.925361 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.926418 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.927352 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:29.927690 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:29.927788 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:29.930321 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:29.930332 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:29.930332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:29.930341 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:29.932433 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.933098 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.933102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.933103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.933182 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:29.933408 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:29.933409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:29.933410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:29.933616 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:29.933729 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:29.933936 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 13:04:29.934070 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":334,"thread_start_us":117,"threads_started":1}
I20260806 13:04:29.934762 3711 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b6c89cb7a944418625892f54c493b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:29 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:53636
I20260806 13:04:29.935489 3788 tablet_replica.cc:330] stopping tablet replica
I20260806 13:04:29.935642 3788 raft_consensus.cc:2229] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:29.935751 3788 raft_consensus.cc:2258] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:29.936159 3788 ts_tablet_manager.cc:1905] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:04:29.938653 3788 ts_tablet_manager.cc:1918] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:04:29.938741 3788 log.cc:1196] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/40b6c89cb7a944418625892f54c493b3
I20260806 13:04:29.939054 3788 ts_tablet_manager.cc:1939] T 40b6c89cb7a944418625892f54c493b3 P e5571eedce1d494d8e20c25f80460c23: Deleting consensus metadata
I20260806 13:04:29.939803 3572 catalog_manager.cc:4841] TS e5571eedce1d494d8e20c25f80460c23 (127.20.245.129:39579): tablet 40b6c89cb7a944418625892f54c493b3 (table test-table [id=9620cb1070ac497d8c1e3344f2a2d5ea]) successfully deleted
W20260806 13:04:30.016512 3784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:30.016877 3784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:30.016932 3784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:30.018549 3784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:30.018679 3784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:30.018744 3784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:04:30.020771 3784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:45913
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=34635
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:30.021088 3784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:30.021371 3784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:30.027606 3796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.027650 3794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.027658 3793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:30.027863 3784 server_base.cc:1034] running on GCE node
I20260806 13:04:30.028318 3784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:30.028687 3784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:30.029874 3784 hybrid_clock.cc:648] HybridClock initialized: now 1786021470029846 us; error 56 us; skew 500 ppm
Aug 06 13:04:30 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:30.033361 3784 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:04:30.033968 3784 webserver.cc:460] Webserver started at http://127.20.245.130:34635/ using document root <none> and password file <none>
I20260806 13:04:30.034271 3784 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:30.034341 3784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:30.036156 3784 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:30.036952 3803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.037159 3784 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:30.037276 3784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "2d60fa16395a44d1ad16ae02f749d2a2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "f7052a133647d5f336cc0303a058f446"
server_key_iv: "70401dac9fcfaaf5f94c6576e0ed7195"
server_key_version: "encryptionkey@0"
I20260806 13:04:30.037726 3784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:30.057209 3784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:30.060420 3784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:30.060647 3784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:30.061000 3784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:30.061424 3784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:30.061483 3784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.061529 3784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:30.061573 3784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.069468 3784 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:45913
I20260806 13:04:30.069512 3917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:45913 every 8 connection(s)
I20260806 13:04:30.070020 3784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
Aug 06 13:04:30 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:30.080019 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 3784
I20260806 13:04:30.080367 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:35371
--local_ip_for_outbound_sockets=127.20.245.131
--tserver_master_addrs=127.20.245.190:33541
--webserver_port=43269
--webserver_interface=127.20.245.131
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:04:30.082430 3781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.071305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:35651 (local address 127.20.245.190:33541)
0806 13:04:30.071393 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.071396 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.071617 (+ 221us) server_negotiation.cc:407] Connection header received
0806 13:04:30.072308 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.072310 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.072323 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.072396 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:30.073641 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.074264 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.075515 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.075770 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.075860 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.078526 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:30.078527 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:30.078528 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:30.078537 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:30.080528 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:30.081175 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:30.081177 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:30.081177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:30.081255 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:30.081557 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:30.081558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:30.081558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:30.081713 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:30.081800 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.082151 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.082293 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 13:04:30.082639 3920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.071185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:35651)
0806 13:04:30.071445 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.071500 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:30.072143 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:30.072496 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:30.072501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:30.073214 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:30.073475 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.073480 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.074379 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.074381 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.075401 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.075404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.075879 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.075880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.076010 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.076740 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:30.076750 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:30.078404 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:30.080772 (+ 2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:30.080784 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:30.080787 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:30.081068 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:30.081337 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:30.081338 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:30.081339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:30.081470 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:30.081787 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:30.081796 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:30.081989 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 13:04:30.082117 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 13:04:30.082334 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":130,"threads_started":1}
I20260806 13:04:30.083541 3918 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33541
I20260806 13:04:30.083689 3918 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:30.083945 3918 heartbeater.cc:511] Master 127.20.245.190:33541 requested a full tablet report, sending...
I20260806 13:04:30.084506 3587 ts_manager.cc:194] Registered new tserver with Master: 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
I20260806 13:04:30.084982 3587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:35651
W20260806 13:04:30.182482 3921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:30.182850 3921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:30.182899 3921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:30.184368 3921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:30.184468 3921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:30.184521 3921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:04:30.186306 3921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:35371
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=43269
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:30.186681 3921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:30.187009 3921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:30.193625 3927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.193629 3928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.193629 3930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:30.194002 3921 server_base.cc:1034] running on GCE node
I20260806 13:04:30.194255 3921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:30.194550 3921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:30.195745 3921 hybrid_clock.cc:648] HybridClock initialized: now 1786021470195718 us; error 46 us; skew 500 ppm
Aug 06 13:04:30 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:30.199229 3921 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:04:30.199800 3921 webserver.cc:460] Webserver started at http://127.20.245.131:43269/ using document root <none> and password file <none>
I20260806 13:04:30.200080 3921 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:30.200152 3921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:30.201838 3921 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:04:30.202754 3937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.203007 3921 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:30.203132 3921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "e900f5f401f0499f9d41c96330db44e2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "090a5cb7fe64d28c210f39e698445f6d"
server_key_iv: "ea23fe5b3e924cad56aa6e9331423802"
server_key_version: "encryptionkey@0"
I20260806 13:04:30.203719 3921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:30.219771 3921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:30.222982 3921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:30.223163 3921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:30.223634 3921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:30.224076 3921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:30.224123 3921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.224150 3921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:30.224164 3921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.233326 3921 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:35371
I20260806 13:04:30.233331 4053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:35371 every 8 connection(s)
I20260806 13:04:30.234001 3921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:04:30.238950 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 3921
Aug 06 13:04:30 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:30.249272 3781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.235593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:59641 (local address 127.20.245.190:33541)
0806 13:04:30.235677 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.235680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.235928 (+ 248us) server_negotiation.cc:407] Connection header received
0806 13:04:30.236605 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.236607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.236623 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.236739 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:30.238446 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.239062 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.240797 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.241220 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.241316 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.245039 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:30.245041 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:30.245042 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:30.245052 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:30.247013 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:30.247785 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:30.247787 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:30.247787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:30.247854 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:30.248210 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:30.248212 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:30.248212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:30.248389 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:30.248474 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.248942 (+ 468us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.249058 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 13:04:30.249425 4057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.239743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54192 (local address 127.20.245.190:33541)
0806 13:04:30.240345 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.240347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.240357 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:04:30.240385 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.240386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.240400 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.240522 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:30.241400 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.242226 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.243596 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.243833 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.243896 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.246006 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:30.246008 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:30.246009 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:30.246017 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:30.247851 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:30.248314 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:30.248315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:30.248315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:30.248382 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:30.248631 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:30.248632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:30.248632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:30.248781 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:30.249083 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.249171 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.249262 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":134,"threads_started":1}
I20260806 13:04:30.249666 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.235370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:59641)
0806 13:04:30.235727 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.235777 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:30.236466 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:30.236856 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:30.236862 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:30.237953 (+ 1091us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:30.238254 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.238262 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.239298 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.239300 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.240688 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.240691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.241537 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.241540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.241809 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.242665 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:30.242681 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:30.244913 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:30.247136 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:30.247152 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:30.247156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:30.247626 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:30.247956 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:30.247957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:30.247957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:30.248115 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:30.248473 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:30.248483 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:30.248753 (+ 270us) client_negotiation.cc:769] Sending connection context
0806 13:04:30.248888 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 13:04:30.249192 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":133,"threads_started":1}
I20260806 13:04:30.250272 4054 heartbeater.cc:347] Connected to a master server at 127.20.245.190:33541
I20260806 13:04:30.250401 4054 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:30.250712 4054 heartbeater.cc:511] Master 127.20.245.190:33541 requested a full tablet report, sending...
I20260806 13:04:30.251281 3587 ts_manager.cc:194] Registered new tserver with Master: e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371)
I20260806 13:04:30.251718 3587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:59641
I20260806 13:04:30.262285 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:04:30.266176 4057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.262918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54202 (local address 127.20.245.190:33541)
0806 13:04:30.263039 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.263042 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.263292 (+ 250us) server_negotiation.cc:407] Connection header received
0806 13:04:30.263371 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.263372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.263428 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.263524 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:04:30.263706 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.264279 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.265189 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.265438 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.265523 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.265736 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:04:30.265883 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:04:30.265990 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.266016 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.266058 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 13:04:30.266774 3587 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54202:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:04:30.269124 3587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:04:30.273016 3711 tablet_service.cc:1467] Processing CreateTablet for tablet 9b1424b09f314ad8a865520b700614a7 (DEFAULT_TABLE table=test-table [id=0eedc53858cb4011ad61059b4d4f8c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:30.273355 3711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b1424b09f314ad8a865520b700614a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:30.275498 3669 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Bootstrap starting.
I20260806 13:04:30.275904 3669 tablet_bootstrap.cc:654] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:30.277485 3786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.272662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:35371 (local address 127.0.0.1:51744)
0806 13:04:30.272754 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.272769 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:30.272815 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:30.273480 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:30.273481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:30.273484 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:30.273573 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.273576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.275049 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.275050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.276169 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.276171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.277085 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.277087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.277189 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.277230 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 13:04:30.277312 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 13:04:30.277385 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":48}
I20260806 13:04:30.277506 4064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.272850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51744 (local address 127.20.245.131:35371)
0806 13:04:30.273220 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.273226 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.273242 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:04:30.273295 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.273297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.273318 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.273467 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:30.273842 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.274925 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.276289 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.276992 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.277061 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.277151 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.277337 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.277395 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":133,"threads_started":1}
I20260806 13:04:30.277602 3669 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: No bootstrap required, opened a new log
I20260806 13:04:30.277618 4065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.273058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48356 (local address 127.20.245.130:45913)
0806 13:04:30.273309 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.273314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.273325 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:04:30.273374 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.273376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.273395 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.273684 (+ 289us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:30.273789 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.274601 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.276289 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.277013 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.277126 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.277188 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.277455 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.277519 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":137,"threads_started":1}
I20260806 13:04:30.277664 3669 ts_tablet_manager.cc:1397] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260806 13:04:30.277853 3669 raft_consensus.cc:348] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.277953 3669 raft_consensus.cc:374] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:30.278043 3669 raft_consensus.cc:729] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5571eedce1d494d8e20c25f80460c23, State: Initialized, Role: FOLLOWER
I20260806 13:04:30.278116 3669 consensus_queue.cc:260] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.278275 3669 ts_tablet_manager.cc:1428] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 13:04:30.278468 4063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.272804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45913 (local address 127.0.0.1:48356)
0806 13:04:30.273054 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.273064 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:30.273123 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:30.273564 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:30.273565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:30.273567 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:30.273607 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.273608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.274737 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.274738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.276162 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.276167 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.277141 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.277142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.277218 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.277244 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 13:04:30.277304 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:04:30.277388 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":29,"thread_start_us":55,"threads_started":1}
I20260806 13:04:30.279126 3986 tablet_service.cc:1467] Processing CreateTablet for tablet 9b1424b09f314ad8a865520b700614a7 (DEFAULT_TABLE table=test-table [id=0eedc53858cb4011ad61059b4d4f8c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:30.279349 3851 tablet_service.cc:1467] Processing CreateTablet for tablet 9b1424b09f314ad8a865520b700614a7 (DEFAULT_TABLE table=test-table [id=0eedc53858cb4011ad61059b4d4f8c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:30.279729 3851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b1424b09f314ad8a865520b700614a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:30.279728 3986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b1424b09f314ad8a865520b700614a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:30.283506 4069 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: Bootstrap starting.
I20260806 13:04:30.283461 4067 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Bootstrap starting.
I20260806 13:04:30.284397 4069 tablet_bootstrap.cc:654] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:30.284576 4067 tablet_bootstrap.cc:654] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:30.285027 4069 log.cc:824] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:30.285176 4067 log.cc:824] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:30.286190 4069 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: No bootstrap required, opened a new log
I20260806 13:04:30.286270 4069 ts_tablet_manager.cc:1397] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:04:30.286336 4067 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: No bootstrap required, opened a new log
I20260806 13:04:30.286419 4067 ts_tablet_manager.cc:1397] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:04:30.288363 4069 raft_consensus.cc:348] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.288566 4069 raft_consensus.cc:374] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:30.288594 4069 raft_consensus.cc:729] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e900f5f401f0499f9d41c96330db44e2, State: Initialized, Role: FOLLOWER
I20260806 13:04:30.288465 4067 raft_consensus.cc:348] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.288697 4067 raft_consensus.cc:374] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:30.288751 4067 raft_consensus.cc:729] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d60fa16395a44d1ad16ae02f749d2a2, State: Initialized, Role: FOLLOWER
I20260806 13:04:30.288751 4069 consensus_queue.cc:260] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.288928 4067 consensus_queue.cc:260] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.289186 4069 ts_tablet_manager.cc:1428] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:04:30.289208 4054 heartbeater.cc:503] Master 127.20.245.190:33541 was elected leader, sending a full tablet report...
I20260806 13:04:30.289279 4067 ts_tablet_manager.cc:1428] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 13:04:30.289424 3918 heartbeater.cc:503] Master 127.20.245.190:33541 was elected leader, sending a full tablet report...
I20260806 13:04:30.295553 3785 raft_consensus.cc:482] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:30.295742 3785 raft_consensus.cc:504] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.296159 3785 leader_election.cc:288] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371), 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
I20260806 13:04:30.301143 4064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.296608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:60053 (local address 127.20.245.131:35371)
0806 13:04:30.296697 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.296700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.296715 (+ 15us) server_negotiation.cc:407] Connection header received
0806 13:04:30.296826 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.296828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.296842 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.296923 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:30.297215 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.298028 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.299980 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.300619 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.300723 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.300734 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.300998 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.301049 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 13:04:30.301143 4065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.296803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:42879 (local address 127.20.245.130:45913)
0806 13:04:30.296864 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.296866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.296968 (+ 102us) server_negotiation.cc:407] Connection header received
0806 13:04:30.297038 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.297039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.297058 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.297131 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:30.297303 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.298033 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.299981 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.300638 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.300718 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.300732 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.300999 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.301048 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 13:04:30.301189 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.296510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:35371 (local address 127.20.245.129:60053)
0806 13:04:30.296586 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.296606 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:30.296730 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:30.296933 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:30.296934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:30.296937 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:30.297052 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.297055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.298178 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.298179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.299854 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.299859 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.300754 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.300756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.300867 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.300902 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 13:04:30.300984 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 13:04:30.301043 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":126}
I20260806 13:04:30.301213 4074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.296679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45913 (local address 127.20.245.129:42879)
0806 13:04:30.296899 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.296907 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:30.296968 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:30.297136 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:30.297137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:30.297140 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:30.297224 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.297226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.298163 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.298164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.299854 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:30.299859 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.300774 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.300776 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:30.300859 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.300902 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 13:04:30.300984 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 13:04:30.301043 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":59,"thread_start_us":160,"threads_started":1}
I20260806 13:04:30.301713 4007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b1424b09f314ad8a865520b700614a7" candidate_uuid: "e5571eedce1d494d8e20c25f80460c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e900f5f401f0499f9d41c96330db44e2" is_pre_election: true
I20260806 13:04:30.301918 4007 raft_consensus.cc:2454] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5571eedce1d494d8e20c25f80460c23 in term 0.
I20260806 13:04:30.302179 3663 leader_election.cc:302] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5571eedce1d494d8e20c25f80460c23, e900f5f401f0499f9d41c96330db44e2; no voters:
I20260806 13:04:30.302390 3785 raft_consensus.cc:2781] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:04:30.302369 3871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b1424b09f314ad8a865520b700614a7" candidate_uuid: "e5571eedce1d494d8e20c25f80460c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" is_pre_election: true
I20260806 13:04:30.302455 3785 raft_consensus.cc:482] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:04:30.302481 3785 raft_consensus.cc:3037] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:30.302551 3871 raft_consensus.cc:2454] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5571eedce1d494d8e20c25f80460c23 in term 0.
I20260806 13:04:30.303522 3785 raft_consensus.cc:504] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.303684 3785 leader_election.cc:288] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 1 election: Requested vote from peers e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371), 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
I20260806 13:04:30.303879 4007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b1424b09f314ad8a865520b700614a7" candidate_uuid: "e5571eedce1d494d8e20c25f80460c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e900f5f401f0499f9d41c96330db44e2"
I20260806 13:04:30.303913 3871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b1424b09f314ad8a865520b700614a7" candidate_uuid: "e5571eedce1d494d8e20c25f80460c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d60fa16395a44d1ad16ae02f749d2a2"
I20260806 13:04:30.303993 3871 raft_consensus.cc:3037] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:30.303994 4007 raft_consensus.cc:3037] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:30.304948 3871 raft_consensus.cc:2454] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5571eedce1d494d8e20c25f80460c23 in term 1.
I20260806 13:04:30.305059 4007 raft_consensus.cc:2454] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5571eedce1d494d8e20c25f80460c23 in term 1.
I20260806 13:04:30.305143 3663 leader_election.cc:302] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d60fa16395a44d1ad16ae02f749d2a2, e5571eedce1d494d8e20c25f80460c23; no voters:
I20260806 13:04:30.305274 3785 raft_consensus.cc:2781] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:30.305509 3785 raft_consensus.cc:686] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 LEADER]: Becoming Leader. State: Replica: e5571eedce1d494d8e20c25f80460c23, State: Running, Role: LEADER
I20260806 13:04:30.305617 3785 consensus_queue.cc:237] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.306690 3587 catalog_manager.cc:5495] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5571eedce1d494d8e20c25f80460c23 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "e5571eedce1d494d8e20c25f80460c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } health_report { overall_health: HEALTHY } } }
I20260806 13:04:30.318753 3787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.316004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42214 (local address 127.20.245.129:39579)
0806 13:04:30.316079 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:30.316082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:30.316093 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:04:30.316167 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:30.316168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:30.316203 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:30.316285 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:04:30.316453 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.317049 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.317824 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:30.318068 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:30.318148 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:30.318342 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:04:30.318484 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:04:30.318577 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:30.318602 (+ 25us) server_negotiation.cc:299] Negotiation successful
0806 13:04:30.318629 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260806 13:04:30.320756 3919 tablet.cc:2369] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:04:30.321103 3871 raft_consensus.cc:1261] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Refusing update from remote peer e5571eedce1d494d8e20c25f80460c23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:30.321110 4007 raft_consensus.cc:1261] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Refusing update from remote peer e5571eedce1d494d8e20c25f80460c23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:30.321583 4075 consensus_queue.cc:1035] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:30.321759 3785 consensus_queue.cc:1035] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:30.324875 4077 mvcc.cc:205] Tried to move back new op lower bound from 7315543942431178752 to 7315543942372724736. Current Snapshot: MvccSnapshot[applied={T|T < 7315543942431178752}]
I20260806 13:04:30.325191 4078 mvcc.cc:205] Tried to move back new op lower bound from 7315543942431178752 to 7315543942372724736. Current Snapshot: MvccSnapshot[applied={T|T < 7315543942431178752}]
I20260806 13:04:30.325870 4079 mvcc.cc:205] Tried to move back new op lower bound from 7315543942431178752 to 7315543942372724736. Current Snapshot: MvccSnapshot[applied={T|T < 7315543942431178752}]
I20260806 13:04:30.329002 3587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:04:30.329131 3587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:04:30.330076 3587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Sending DeleteTablet for 3 replicas of tablet 9b1424b09f314ad8a865520b700614a7
I20260806 13:04:30.331203 3711 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b1424b09f314ad8a865520b700614a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:30 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:53636
I20260806 13:04:30.331365 3788 tablet_replica.cc:330] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: stopping tablet replica
I20260806 13:04:30.331444 3788 raft_consensus.cc:2229] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:04:30.331569 3788 raft_consensus.cc:2258] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:30.331651 3986 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b1424b09f314ad8a865520b700614a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:30 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:51744
I20260806 13:04:30.331753 3851 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b1424b09f314ad8a865520b700614a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:30 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:48356
I20260806 13:04:30.331954 4086 tablet_replica.cc:330] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: stopping tablet replica
I20260806 13:04:30.332079 4086 raft_consensus.cc:2229] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:30.332088 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 3626
I20260806 13:04:30.332204 4086 raft_consensus.cc:2258] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:30.333058 4086 ts_tablet_manager.cc:1905] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:04:30.334074 4087 tablet_replica.cc:330] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: stopping tablet replica
I20260806 13:04:30.334260 4087 raft_consensus.cc:2229] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:30.334405 4087 raft_consensus.cc:2258] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:30.335480 4086 ts_tablet_manager.cc:1918] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:04:30.335573 4086 log.cc:1196] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/9b1424b09f314ad8a865520b700614a7
I20260806 13:04:30.335897 4086 ts_tablet_manager.cc:1939] T 9b1424b09f314ad8a865520b700614a7 P e900f5f401f0499f9d41c96330db44e2: Deleting consensus metadata
I20260806 13:04:30.336483 3571 catalog_manager.cc:4841] TS e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371): tablet 9b1424b09f314ad8a865520b700614a7 (table test-table [id=0eedc53858cb4011ad61059b4d4f8c2a]) successfully deleted
I20260806 13:04:30.339835 4087 ts_tablet_manager.cc:1905] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 13:04:30.340096 3572 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:39579 (error 108)
I20260806 13:04:30.341001 4063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.340822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39579 (local address 127.0.0.1:42224)
0806 13:04:30.340896 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.340951 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:39579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 13:04:30.341087 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 3784
W20260806 13:04:30.343756 3572 catalog_manager.cc:4584] TS e5571eedce1d494d8e20c25f80460c23 (127.20.245.129:39579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9b1424b09f314ad8a865520b700614a7: Network error: Client connection negotiation failed: client connection to 127.20.245.129:39579: connect: Connection refused (error 111)
I20260806 13:04:30.349009 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 3921
I20260806 13:04:30.349058 4063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.348906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45913 (local address 127.0.0.1:48366)
0806 13:04:30.348970 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.349009 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.130:45913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 13:04:30.355834 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 3554
I20260806 13:04:30.363938 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33541
--webserver_interface=127.20.245.190
--webserver_port=46183
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:33541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:30.474874 4089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:30.475211 4089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:30.475244 4089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:30.476794 4089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:30.476861 4089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:30.476877 4089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:30.476892 4089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:30.476907 4089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:30.478808 4089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:33541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:30.479197 4089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:30.479524 4089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:30.486007 4094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.486009 4095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.486045 4097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:30.486347 4089 server_base.cc:1034] running on GCE node
I20260806 13:04:30.486672 4089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:30.487061 4089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:30.488246 4089 hybrid_clock.cc:648] HybridClock initialized: now 1786021470488214 us; error 48 us; skew 500 ppm
Aug 06 13:04:30 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:30.491580 4089 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:04:30.492183 4089 webserver.cc:460] Webserver started at http://127.20.245.190:46183/ using document root <none> and password file <none>
I20260806 13:04:30.492488 4089 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:30.492542 4089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:30.494231 4089 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:30.495077 4104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.495314 4089 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:30.495426 4089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "04e2d42416534ba1bf81febca244f083"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "cc25cbf6cae8b0634c342fd7aa7c25d4"
server_key_iv: "27936193cb1a33797351dcf74d8ff16c"
server_key_version: "encryptionkey@0"
I20260806 13:04:30.495919 4089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:30.510406 4089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:30.513587 4089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:30.513814 4089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:30.519243 4089 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:33541
I20260806 13:04:30.519300 4158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:33541 every 8 connection(s)
I20260806 13:04:30.519814 4089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:04:30.521973 4159 sys_catalog.cc:263] Verifying existing consensus state
I20260806 13:04:30.522786 4159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Bootstrap starting.
I20260806 13:04:30.523554 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 4089
I20260806 13:04:30.523969 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:39579
--local_ip_for_outbound_sockets=127.20.245.129
--tserver_master_addrs=127.20.245.190:33541
--webserver_port=43001
--webserver_interface=127.20.245.129
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:04:30.535847 4159 log.cc:824] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:30.538848 4159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:04:30.539374 4159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083: Bootstrap complete.
I20260806 13:04:30.542295 4159 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:30.542586 4159 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e2d42416534ba1bf81febca244f083, State: Initialized, Role: FOLLOWER
I20260806 13:04:30.542810 4159 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:30.542899 4159 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:04:30.542968 4159 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:04:30.543028 4159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 2 FOLLOWER]: Advancing to term 3
I20260806 13:04:30.544472 4159 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:30.544631 4159 leader_election.cc:302] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04e2d42416534ba1bf81febca244f083; no voters:
I20260806 13:04:30.544917 4159 leader_election.cc:288] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 13:04:30.544967 4163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 13:04:30.545117 4163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [term 3 LEADER]: Becoming Leader. State: Replica: 04e2d42416534ba1bf81febca244f083, State: Running, Role: LEADER
I20260806 13:04:30.545231 4163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } }
I20260806 13:04:30.545302 4159 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:30.545596 4163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e2d42416534ba1bf81febca244f083. Latest consensus state: current_term: 3 leader_uuid: "04e2d42416534ba1bf81febca244f083" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } } }
I20260806 13:04:30.545686 4163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:30.545604 4164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "04e2d42416534ba1bf81febca244f083" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e2d42416534ba1bf81febca244f083" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33541 } } }
I20260806 13:04:30.545928 4164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e2d42416534ba1bf81febca244f083 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:30.546540 4167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:04:30.547571 4167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:04:30.547688 4167 catalog_manager.cc:1259] Loaded cluster ID: 2def6be2e8964009a96bb82b0d444465
I20260806 13:04:30.547729 4167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 13:04:30.548094 4167 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f157d86f9ad google::LogMessage::Fail() at ??:0
@ 0x7f157d87288a google::LogMessage::SendToLog() at ??:0
@ 0x7f157d86f4de google::LogMessage::Flush() at ??:0
@ 0x7f157d870a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f15857940f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f158579d8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f157f73d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f157f732954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f15805966db start_thread at ??:0
@ 0x7f157c36d61f clone at ??:0
W20260806 13:04:30.645267 4161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:30.645576 4161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:30.645610 4161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:30.647328 4161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:30.647395 4161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:30.647436 4161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:04:30.649531 4161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:39579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=43001
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:30.649950 4161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:30.650344 4161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:30.657076 4196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.657143 4199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.657076 4197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:30.657442 4161 server_base.cc:1034] running on GCE node
I20260806 13:04:30.657873 4161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:30.658267 4161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:30.659459 4161 hybrid_clock.cc:648] HybridClock initialized: now 1786021470659437 us; error 43 us; skew 500 ppm
Aug 06 13:04:30 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:30.663247 4161 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:04:30.663872 4161 webserver.cc:460] Webserver started at http://127.20.245.129:43001/ using document root <none> and password file <none>
I20260806 13:04:30.664192 4161 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:30.664274 4161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:30.666085 4161 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:04:30.667263 4207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.667521 4161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:30.667680 4161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "e5571eedce1d494d8e20c25f80460c23"
format_stamp: "Formatted at 2026-08-06 13:04:28 on dist-test-slave-srgv"
server_key: "8493c13c0ccd5bd94ae6349f276f33dc"
server_key_iv: "283cbd92b9056d4dc843dcda238633f4"
server_key_version: "encryptionkey@0"
I20260806 13:04:30.668212 4161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:30.680162 4161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:30.683161 4161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:30.683517 4161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:30.683856 4161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:30.684468 4214 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 13:04:30.687038 4161 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 13:04:30.687134 4161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260806 13:04:30.687249 4161 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 13:04:30.688161 4161 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 13:04:30.688233 4161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 13:04:30.688333 4214 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Bootstrap starting.
I20260806 13:04:30.697444 4161 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:39579
I20260806 13:04:30.697676 4324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:39579 every 8 connection(s)
I20260806 13:04:30.698073 4161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:04:30.702258 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 4161
I20260806 13:04:30.702695 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:45913
--local_ip_for_outbound_sockets=127.20.245.130
--tserver_master_addrs=127.20.245.190:33541
--webserver_port=34635
--webserver_interface=127.20.245.130
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:04:30.704044 4214 log.cc:824] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:30.707368 4214 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:04:30.707746 4214 tablet_bootstrap.cc:492] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Bootstrap complete.
I20260806 13:04:30.708880 4214 ts_tablet_manager.cc:1397] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.008s
I20260806 13:04:30.710258 4214 raft_consensus.cc:348] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.710577 4214 raft_consensus.cc:729] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5571eedce1d494d8e20c25f80460c23, State: Initialized, Role: FOLLOWER
I20260806 13:04:30.710781 4214 consensus_queue.cc:260] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:30.711266 4214 ts_tablet_manager.cc:1428] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
W20260806 13:04:30.818938 4327 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:04:30.699057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:47449)
0806 13:04:30.699345 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.699393 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:30.700001 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:30.818588 (+118587us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":179,"threads_started":1}
W20260806 13:04:30.819379 4325 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:33541 (0 consecutive failures): Network error: Failed to ping master at 127.20.245.190:33541: Client connection negotiation failed: client connection to 127.20.245.190:33541: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 13:04:30.819842 4327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.819680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:50067)
0806 13:04:30.819759 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.819819 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 13:04:30.820348 4327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.820183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:43717)
0806 13:04:30.820286 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.820319 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260806 13:04:30.820472 4325 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 13:04:30.837193 4330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:30.837497 4330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:30.837528 4330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:30.838956 4330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:30.839015 4330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:30.839076 4330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:04:30.840878 4330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:45913
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=34635
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:30.841217 4330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:30.841543 4330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:30.847499 4336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.847491 4337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:30.847491 4339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:30.847613 4330 server_base.cc:1034] running on GCE node
I20260806 13:04:30.848011 4330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:30.848366 4330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:30.849558 4330 hybrid_clock.cc:648] HybridClock initialized: now 1786021470849550 us; error 56 us; skew 500 ppm
Aug 06 13:04:30 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:30.853039 4330 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:04:30.853657 4330 webserver.cc:460] Webserver started at http://127.20.245.130:34635/ using document root <none> and password file <none>
I20260806 13:04:30.853964 4330 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:30.854044 4330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:30.855815 4330 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 13:04:30.856752 4346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.856998 4330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:04:30.857121 4330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "2d60fa16395a44d1ad16ae02f749d2a2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "f7052a133647d5f336cc0303a058f446"
server_key_iv: "70401dac9fcfaaf5f94c6576e0ed7195"
server_key_version: "encryptionkey@0"
I20260806 13:04:30.857582 4330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:30.876930 4330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:30.879407 4330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:30.879559 4330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:30.879835 4330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:30.880411 4353 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260806 13:04:30.882207 4353 ts_tablet_manager.cc:1852] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260806 13:04:30.882592 4353 ts_tablet_manager.cc:1905] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:04:30.885164 4353 ts_tablet_manager.cc:1918] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:04:30.885351 4353 log.cc:1196] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/9b1424b09f314ad8a865520b700614a7
I20260806 13:04:30.885658 4353 ts_tablet_manager.cc:1939] T 9b1424b09f314ad8a865520b700614a7 P 2d60fa16395a44d1ad16ae02f749d2a2: Deleting consensus metadata
I20260806 13:04:30.885915 4330 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260806 13:04:30.885967 4330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260806 13:04:30.886000 4330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:30.886013 4330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:30.893936 4330 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:45913
I20260806 13:04:30.894002 4462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:45913 every 8 connection(s)
I20260806 13:04:30.894433 4330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:04:30.895737 4465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.895275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:49701)
0806 13:04:30.895466 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.895558 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
W20260806 13:04:30.896032 4463 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:33541 (0 consecutive failures): Network error: Failed to ping master at 127.20.245.190:33541: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
I20260806 13:04:30.896344 4465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.896249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:35315)
0806 13:04:30.896297 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.896326 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 13:04:30.896639 4465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:30.896564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:50503)
0806 13:04:30.896604 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:30.896626 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 13:04:30.896831 4463 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 13:04:30.901995 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 4330
I20260806 13:04:30.902323 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:35371
--local_ip_for_outbound_sockets=127.20.245.131
--tserver_master_addrs=127.20.245.190:33541
--webserver_port=43269
--webserver_interface=127.20.245.131
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:31.004586 4466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:31.004885 4466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:31.004920 4466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:31.006515 4466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:31.006583 4466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:31.006619 4466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:04:31.008569 4466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:35371
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=43269
--tserver_master_addrs=127.20.245.190:33541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:31.008877 4466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:31.009138 4466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:31.015543 4472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:31.015543 4471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:31.015621 4474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:31.015936 4466 server_base.cc:1034] running on GCE node
I20260806 13:04:31.016179 4466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:31.016463 4466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:31.017655 4466 hybrid_clock.cc:648] HybridClock initialized: now 1786021471017640 us; error 35 us; skew 500 ppm
Aug 06 13:04:31 dist-test-slave-srgv krb5kdc[2990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021471, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:31.021145 4466 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:04:31.021710 4466 webserver.cc:460] Webserver started at http://127.20.245.131:43269/ using document root <none> and password file <none>
I20260806 13:04:31.022030 4466 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:31.022118 4466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:31.023829 4466 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:04:31.024609 4481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:31.024806 4466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:31.024924 4466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "e900f5f401f0499f9d41c96330db44e2"
format_stamp: "Formatted at 2026-08-06 13:04:29 on dist-test-slave-srgv"
server_key: "090a5cb7fe64d28c210f39e698445f6d"
server_key_iv: "ea23fe5b3e924cad56aa6e9331423802"
server_key_version: "encryptionkey@0"
I20260806 13:04:31.025444 4466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:31.054268 4466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:31.057487 4466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:31.057703 4466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:31.058035 4466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:31.058449 4466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:31.058507 4466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:31.058557 4466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:31.058605 4466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:31.066143 4466 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:35371
I20260806 13:04:31.066188 4595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:35371 every 8 connection(s)
I20260806 13:04:31.066650 4466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:04:31.068187 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.067605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:53173)
0806 13:04:31.067853 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:31.067965 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":107,"threads_started":1}
W20260806 13:04:31.068775 4596 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:33541 (0 consecutive failures): Network error: Failed to ping master at 127.20.245.190:33541: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
I20260806 13:04:31.069185 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.069039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:59771)
0806 13:04:31.069113 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:31.069150 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 13:04:31.069581 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.069454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:55375)
0806 13:04:31.069519 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:31.069549 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 13:04:31.069779 4596 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 13:04:31.070559 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 4466
I20260806 13:04:31.821442 4600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.821037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:60797)
0806 13:04:31.821284 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:31.821346 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":93,"threads_started":1}
I20260806 13:04:31.897616 4601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.897311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:38399)
0806 13:04:31.897515 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:31.897573 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":87,"threads_started":1}
I20260806 13:04:31.979252 4602 raft_consensus.cc:482] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:31.979468 4602 raft_consensus.cc:504] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:31.980012 4602 leader_election.cc:288] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371), 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
Aug 06 13:04:31 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.131@KRBTEST.COM
Aug 06 13:04:31 dist-test-slave-srgv krb5kdc[2990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021470, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.130@KRBTEST.COM
I20260806 13:04:31.995616 4605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.980497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:35835 (local address 127.20.245.131:35371)
0806 13:04:31.980717 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:31.980735 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:31.980770 (+ 35us) server_negotiation.cc:407] Connection header received
0806 13:04:31.981524 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:31.981529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:31.981629 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:31.981837 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:31.983118 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:31.984670 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:31.986393 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:31.986903 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:31.987003 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:31.990207 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:31.990213 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:31.990214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:31.990278 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:31.992834 (+ 2556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:31.993716 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:31.993721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:31.993722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:31.993874 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:31.994282 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:31.994283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:31.994283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:31.994702 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:31.994804 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:31.995324 (+ 520us) server_negotiation.cc:299] Negotiation successful
0806 13:04:31.995491 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":123,"threads_started":1}
I20260806 13:04:31.995630 4606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.980631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:56351 (local address 127.20.245.130:45913)
0806 13:04:31.980854 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:31.980915 (+ 61us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:31.980949 (+ 34us) server_negotiation.cc:407] Connection header received
0806 13:04:31.981632 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:31.981635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:31.981695 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:31.981837 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:31.983119 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:31.984648 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:31.986460 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:31.986973 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:31.987113 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:31.990483 (+ 3370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:31.990488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:31.990489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:31.990504 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:31.992838 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:31.993722 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:31.993725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:31.993725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:31.993874 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:31.994286 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:31.994287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:31.994288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:31.994702 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:31.994804 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:31.995305 (+ 501us) server_negotiation.cc:299] Negotiation successful
0806 13:04:31.995489 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":112,"threads_started":1}
I20260806 13:04:31.995601 4604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.980487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:45913 (local address 127.20.245.129:56351)
0806 13:04:31.980655 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:31.980671 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:31.980759 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:31.981986 (+ 1227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:31.981990 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:31.982576 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:31.982923 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:31.982933 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:31.984840 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:31.984841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:31.986289 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:31.986298 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:31.987095 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:31.987097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:31.987221 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:31.988060 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:31.988066 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:31.990281 (+ 2215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:31.992984 (+ 2703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:31.993000 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:31.993004 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:31.993595 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:31.993974 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:31.993975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:31.993975 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:31.994192 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:31.994809 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:31.994825 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:31.995035 (+ 210us) client_negotiation.cc:769] Sending connection context
0806 13:04:31.995199 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 13:04:31.995447 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":153,"thread_start_us":82,"threads_started":1}
I20260806 13:04:31.995601 4600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:31.980305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:35371 (local address 127.20.245.129:35835)
0806 13:04:31.980424 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:31.980446 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:31.980550 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:31.981986 (+ 1436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:31.981990 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:31.982576 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:31.982923 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:31.982933 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:31.984837 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:31.984839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:31.986271 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:31.986275 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:31.987022 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:31.987024 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:31.987165 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:31.988007 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:31.988018 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:31.989971 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:31.992984 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:31.993000 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:31.993004 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:31.993596 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:31.993974 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:31.993975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:31.993975 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:31.994192 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:31.994809 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:31.994818 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:31.995035 (+ 217us) client_negotiation.cc:769] Sending connection context
0806 13:04:31.995199 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 13:04:31.995507 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":181}
W20260806 13:04:31.997007 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
W20260806 13:04:31.997112 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
I20260806 13:04:31.997131 4208 leader_election.cc:302] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5571eedce1d494d8e20c25f80460c23; no voters: 2d60fa16395a44d1ad16ae02f749d2a2, e900f5f401f0499f9d41c96330db44e2
I20260806 13:04:31.997296 4602 raft_consensus.cc:2726] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:04:32.070559 4607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:32.070233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:37621)
0806 13:04:32.070408 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:32.070494 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":73,"threads_started":1}
I20260806 13:04:32.822438 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:32.822074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:57557)
0806 13:04:32.822297 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:32.822367 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":85,"threads_started":1}
I20260806 13:04:32.898819 4609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:32.898262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:43079)
0806 13:04:32.898701 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:32.898755 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":100,"threads_started":1}
I20260806 13:04:33.071895 4610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:33.071430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:48057)
0806 13:04:33.071697 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:33.071820 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":122,"threads_started":1}
I20260806 13:04:33.705461 4611 raft_consensus.cc:482] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:33.705615 4611 raft_consensus.cc:504] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:33.705837 4611 leader_election.cc:288] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371), 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
W20260806 13:04:33.706646 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
W20260806 13:04:33.706733 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
I20260806 13:04:33.706753 4208 leader_election.cc:302] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5571eedce1d494d8e20c25f80460c23; no voters: 2d60fa16395a44d1ad16ae02f749d2a2, e900f5f401f0499f9d41c96330db44e2
I20260806 13:04:33.706837 4611 raft_consensus.cc:2726] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:04:33.823472 4612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:33.823133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:39531)
0806 13:04:33.823352 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:33.823402 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":135,"threads_started":1}
I20260806 13:04:33.899727 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:33.899427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:45341)
0806 13:04:33.899617 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:33.899680 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":89,"threads_started":1}
I20260806 13:04:34.072780 4614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:34.072486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:51925)
0806 13:04:34.072661 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:34.072715 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
I20260806 13:04:34.824585 4615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:34.824250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:41461)
0806 13:04:34.824461 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:34.824520 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":95,"threads_started":1}
I20260806 13:04:34.900698 4616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:34.900357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:54943)
0806 13:04:34.900583 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:34.900636 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":125,"threads_started":1}
I20260806 13:04:35.073781 4617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:35.073452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:39835)
0806 13:04:35.073620 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:35.073679 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260806 13:04:35.670342 4618 raft_consensus.cc:482] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:35.670548 4618 raft_consensus.cc:504] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:35.670832 4618 leader_election.cc:288] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371), 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
W20260806 13:04:35.671474 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
W20260806 13:04:35.671546 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
I20260806 13:04:35.671564 4208 leader_election.cc:302] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5571eedce1d494d8e20c25f80460c23; no voters: 2d60fa16395a44d1ad16ae02f749d2a2, e900f5f401f0499f9d41c96330db44e2
I20260806 13:04:35.671661 4618 raft_consensus.cc:2726] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:04:35.825728 4619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:35.825370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:40081)
0806 13:04:35.825586 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:35.825656 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":95,"threads_started":1}
I20260806 13:04:35.901687 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:35.901379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:50355)
0806 13:04:35.901565 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:35.901620 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":91,"threads_started":1}
I20260806 13:04:36.074765 4621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:36.074480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:33885)
0806 13:04:36.074662 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:36.074712 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
I20260806 13:04:36.826964 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:36.826617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:49693)
0806 13:04:36.826837 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:36.826905 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":108,"threads_started":1}
I20260806 13:04:36.902788 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:36.902467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:44409)
0806 13:04:36.902674 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:36.902739 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":113,"threads_started":1}
I20260806 13:04:37.075990 4624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:37.075564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:44143)
0806 13:04:37.075816 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:37.075881 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":109,"threads_started":1}
I20260806 13:04:37.827937 4625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:37.827616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:48097)
0806 13:04:37.827812 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:37.827871 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":90,"threads_started":1}
I20260806 13:04:37.903822 4626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:37.903500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:33423)
0806 13:04:37.903694 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:37.903752 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
I20260806 13:04:38.077288 4627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:38.076808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:32957)
0806 13:04:38.077118 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:38.077183 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":92,"threads_started":1}
I20260806 13:04:38.828941 4628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:38.828649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:55411)
0806 13:04:38.828838 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:38.828877 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":99,"threads_started":1}
I20260806 13:04:38.904690 4629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:38.904357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:38737)
0806 13:04:38.904557 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:38.904622 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":89,"threads_started":1}
I20260806 13:04:39.078418 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:39.077946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:40019)
0806 13:04:39.078152 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:39.078199 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":114,"threads_started":1}
I20260806 13:04:39.286049 4631 raft_consensus.cc:482] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:39.286234 4631 raft_consensus.cc:504] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:39.286482 4631 leader_election.cc:288] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371), 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
W20260806 13:04:39.287001 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
W20260806 13:04:39.287073 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
I20260806 13:04:39.287091 4208 leader_election.cc:302] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5571eedce1d494d8e20c25f80460c23; no voters: 2d60fa16395a44d1ad16ae02f749d2a2, e900f5f401f0499f9d41c96330db44e2
I20260806 13:04:39.287237 4631 raft_consensus.cc:2726] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:04:39.829991 4632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:39.829667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:48405)
0806 13:04:39.829866 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:39.829922 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":96,"threads_started":1}
I20260806 13:04:39.905685 4633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:39.905352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:42257)
0806 13:04:39.905558 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:39.905616 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":91,"threads_started":1}
I20260806 13:04:40.079507 4634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:40.079151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:46763)
0806 13:04:40.079384 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:40.079438 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":149,"threads_started":1}
I20260806 13:04:40.830996 4635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:40.830651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:40617)
0806 13:04:40.830882 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:40.830932 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":107,"threads_started":1}
I20260806 13:04:40.906749 4636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:40.906436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:50017)
0806 13:04:40.906619 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:40.906673 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":90,"threads_started":1}
I20260806 13:04:41.080698 4638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:41.080336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:55309)
0806 13:04:41.080557 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:41.080632 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":125,"threads_started":1}
I20260806 13:04:41.832134 4639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:41.831761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:37375)
0806 13:04:41.832008 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:41.832078 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":98,"threads_started":1}
I20260806 13:04:41.907896 4640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:41.907483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:42519)
0806 13:04:41.907747 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:41.907827 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":82,"threads_started":1}
I20260806 13:04:42.081964 4641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:42.081620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:34257)
0806 13:04:42.081835 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:42.081902 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":115,"threads_started":1}
I20260806 13:04:42.833241 4642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:42.832868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:59641)
0806 13:04:42.833121 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:42.833187 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":101,"threads_started":1}
I20260806 13:04:42.909013 4643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:42.908701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:54373)
0806 13:04:42.908880 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:42.908945 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":80,"threads_started":1}
I20260806 13:04:43.083128 4644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:43.082721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:54385)
0806 13:04:43.082999 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:43.083069 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":124,"threads_started":1}
I20260806 13:04:43.834319 4645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:43.833968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:42461)
0806 13:04:43.834178 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:43.834244 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":99,"threads_started":1}
I20260806 13:04:43.910066 4646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:43.909755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:45387)
0806 13:04:43.909941 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:43.909997 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":95,"threads_started":1}
I20260806 13:04:44.084227 4647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:44.083923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:48889)
0806 13:04:44.084100 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:44.084158 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260806 13:04:44.835448 4648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:44.835048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:45553)
0806 13:04:44.835311 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:44.835374 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":96,"threads_started":1}
I20260806 13:04:44.911115 4649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:44.910785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:41423)
0806 13:04:44.910994 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:44.911048 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":140,"threads_started":1}
I20260806 13:04:45.000913 4650 raft_consensus.cc:482] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:45.001109 4650 raft_consensus.cc:504] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e900f5f401f0499f9d41c96330db44e2" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35371 } } peers { permanent_uuid: "2d60fa16395a44d1ad16ae02f749d2a2" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 45913 } } peers { permanent_uuid: "e5571eedce1d494d8e20c25f80460c23" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39579 } }
I20260806 13:04:45.001416 4650 leader_election.cc:288] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371), 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913)
W20260806 13:04:45.002013 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e900f5f401f0499f9d41c96330db44e2 (127.20.245.131:35371): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
W20260806 13:04:45.002082 4208 leader_election.cc:341] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d60fa16395a44d1ad16ae02f749d2a2 (127.20.245.130:45913): Not found: Tablet not found: 9b1424b09f314ad8a865520b700614a7
I20260806 13:04:45.002185 4208 leader_election.cc:302] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5571eedce1d494d8e20c25f80460c23; no voters: 2d60fa16395a44d1ad16ae02f749d2a2, e900f5f401f0499f9d41c96330db44e2
I20260806 13:04:45.002290 4650 raft_consensus.cc:2726] T 9b1424b09f314ad8a865520b700614a7 P e5571eedce1d494d8e20c25f80460c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:04:45.085216 4651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:45.084914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:43765)
0806 13:04:45.085093 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:45.085147 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":90,"threads_started":1}
I20260806 13:04:45.836638 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:45.836317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.129:42227)
0806 13:04:45.836507 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:45.836564 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":85,"threads_started":1}
I20260806 13:04:45.912406 4653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:45.912001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.130:47973)
0806 13:04:45.912288 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:45.912343 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":94,"threads_started":1}
I20260806 13:04:46.080576 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 4161
I20260806 13:04:46.086463 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:46.086082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33541 (local address 127.20.245.131:46539)
0806 13:04:46.086301 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:46.086368 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:33541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":123,"threads_started":1}
I20260806 13:04:46.090981 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 4330
I20260806 13:04:46.097522 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 4466
2026-08-06T13:04:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18870 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:04:46 dist-test-slave-srgv krb5kdc[4657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:04:46 dist-test-slave-srgv krb5kdc[4657](info): set up 2 sockets
Aug 06 13:04:46 dist-test-slave-srgv krb5kdc[4657](info): commencing operation
krb5kdc: starting...
W20260806 13:04:47.256150 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:04:47 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:04:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:04:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:04:47.404476 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46585
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:46585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:47.502077 4671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:47.502343 4671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:47.502372 4671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:47.503808 4671 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 13:04:47.503857 4671 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 13:04:47.503871 4671 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 13:04:47.503883 4671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:04:47.503896 4671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:47.503934 4671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:47.503964 4671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:04:47.503983 4671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:04:47.505607 4671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:46585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:47.505925 4671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:47.506219 4671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:04:47.512924 4671 server_base.cc:1034] running on GCE node
W20260806 13:04:47.512892 4676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:47.512884 4679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:47.512871 4677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:47.513509 4671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:47.513888 4671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:47.515043 4671 hybrid_clock.cc:648] HybridClock initialized: now 1786021487515022 us; error 42 us; skew 500 ppm
Aug 06 13:04:47 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:47.518153 4671 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:04:47.518764 4671 webserver.cc:460] Webserver started at http://127.20.245.190:39025/ using document root <none> and password file <none>
I20260806 13:04:47.519071 4671 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:47.519148 4671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:47.519374 4671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:47.520694 4671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "d1d6070122ad46998a070d44aa4b8c90"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b47b6fdeec4f97c167a1f02a5742545"
server_key_iv: "a2d614e7c178c22c5a41853e28da99fe"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.521143 4671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "d1d6070122ad46998a070d44aa4b8c90"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b47b6fdeec4f97c167a1f02a5742545"
server_key_iv: "a2d614e7c178c22c5a41853e28da99fe"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.522791 4671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 13:04:47.523773 4686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:47.523964 4671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:04:47.524076 4671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "d1d6070122ad46998a070d44aa4b8c90"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b47b6fdeec4f97c167a1f02a5742545"
server_key_iv: "a2d614e7c178c22c5a41853e28da99fe"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.524170 4671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:47.542140 4671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:47.544911 4671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:47.545133 4671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:47.550336 4671 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:46585
I20260806 13:04:47.550376 4739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:46585 every 8 connection(s)
I20260806 13:04:47.550828 4671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:04:47.551789 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 4671
I20260806 13:04:47.551923 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:04:47.552213 4740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:47.552286 21462 external_mini_cluster.cc:1428] Setting key 316d9cd7c4eed3563c5035288f5e0f6f
I20260806 13:04:47.556097 4740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Bootstrap starting.
I20260806 13:04:47.556857 4740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:47.557204 4740 log.cc:824] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:47.558090 4740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: No bootstrap required, opened a new log
Aug 06 13:04:47 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:47.561043 4740 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:04:47.561264 4740 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:47.561332 4740 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d6070122ad46998a070d44aa4b8c90, State: Initialized, Role: FOLLOWER
I20260806 13:04:47.561506 4740 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:04:47.561605 4740 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:04:47.561653 4740 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:04:47.561726 4740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:47.562448 4740 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:04:47.562552 4740 leader_election.cc:302] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1d6070122ad46998a070d44aa4b8c90; no voters:
I20260806 13:04:47.562831 4740 leader_election.cc:288] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:04:47.562870 4745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:47.563005 4745 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 1 LEADER]: Becoming Leader. State: Replica: d1d6070122ad46998a070d44aa4b8c90, State: Running, Role: LEADER
I20260806 13:04:47.563220 4740 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:04:47.563232 4745 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:04:47.563812 4747 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1d6070122ad46998a070d44aa4b8c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } } }
I20260806 13:04:47.563915 4747 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:47.564222 4748 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1d6070122ad46998a070d44aa4b8c90. Latest consensus state: current_term: 1 leader_uuid: "d1d6070122ad46998a070d44aa4b8c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } } }
I20260806 13:04:47.564352 4748 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: This master's current role is: LEADER
I20260806 13:04:47.564546 4755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:04:47.565241 4755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:04:47.565706 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:47.553000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40646 (local address 127.20.245.190:46585)
0806 13:04:47.553239 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:47.553248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:47.553278 (+ 30us) server_negotiation.cc:407] Connection header received
0806 13:04:47.553972 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:47.553980 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:47.554037 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:47.554219 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:47.555103 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:47.556189 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:47.557024 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:47.557520 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:47.557609 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:47.560689 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:47.560696 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:47.560697 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:47.560712 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:47.563157 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:47.563626 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:47.563631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:47.563631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:47.563785 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:47.564044 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:47.564045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:47.564045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:47.564439 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:47.565147 (+ 708us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:47.565238 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 13:04:47.565424 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":97,"threads_started":1}
I20260806 13:04:47.567127 4755 catalog_manager.cc:1347] Generated new cluster ID: 2a32ffa137344f2790ffae4a8d34ed93
I20260806 13:04:47.567219 4755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:04:47.577185 4755 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:04:47.578128 4755 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:04:47.583127 4755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Generated new TSK 0
I20260806 13:04:47.583452 4755 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:04:47.621995 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46585
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:47.749244 4767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:47.749533 4767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:47.749608 4767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:47.751076 4767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:47.751135 4767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:47.751165 4767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:04:47.752955 4767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:47.753306 4767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:47.753610 4767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:47.759567 4772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:47.759568 4775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:47.759567 4773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:47.759933 4767 server_base.cc:1034] running on GCE node
I20260806 13:04:47.760177 4767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:47.760497 4767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:47.761700 4767 hybrid_clock.cc:648] HybridClock initialized: now 1786021487761685 us; error 49 us; skew 500 ppm
Aug 06 13:04:47 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:47.765182 4767 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:04:47.765789 4767 webserver.cc:460] Webserver started at http://127.20.245.129:43159/ using document root <none> and password file <none>
I20260806 13:04:47.766088 4767 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:47.766165 4767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:47.766343 4767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:47.767728 4767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "5f922b86e15140b88073be8859f17d41"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "a6637fa3d089e01ca0bc9498f976b6e6"
server_key_iv: "c7d158065091e11bcfebb4a7f3d0e391"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.768159 4767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "5f922b86e15140b88073be8859f17d41"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "a6637fa3d089e01ca0bc9498f976b6e6"
server_key_iv: "c7d158065091e11bcfebb4a7f3d0e391"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.769842 4767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:04:47.770812 4782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:47.771011 4767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:47.771130 4767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "5f922b86e15140b88073be8859f17d41"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "a6637fa3d089e01ca0bc9498f976b6e6"
server_key_iv: "c7d158065091e11bcfebb4a7f3d0e391"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.771243 4767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:47.797896 4767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:47.801404 4767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:47.801612 4767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:47.801961 4767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:47.802405 4767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:47.802448 4767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:47.802479 4767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:47.802534 4767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:47.810300 4767 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:34603
I20260806 13:04:47.810395 4897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:34603 every 8 connection(s)
I20260806 13:04:47.810869 4767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
Aug 06 13:04:47 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:47.821036 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 4767
I20260806 13:04:47.821199 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:04:47.821508 21462 external_mini_cluster.cc:1428] Setting key 8c495589faa3ca368a96beb2d35c9ccc
I20260806 13:04:47.823853 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:47.811962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:51697 (local address 127.20.245.190:46585)
0806 13:04:47.812044 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:47.812046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:47.812311 (+ 265us) server_negotiation.cc:407] Connection header received
0806 13:04:47.812929 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:47.812931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:47.812945 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:47.813019 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:47.814297 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:47.814970 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:47.816366 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:47.816638 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:47.816730 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:47.819751 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:47.819754 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:47.819755 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:47.819766 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:47.821567 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:47.822256 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:47.822258 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:47.822258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:47.822350 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:47.822883 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:47.822885 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:47.822885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:47.823060 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:47.823138 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:47.823604 (+ 466us) server_negotiation.cc:299] Negotiation successful
0806 13:04:47.823760 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:04:47.824198 4900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:47.811895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:51697)
0806 13:04:47.812109 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:47.812163 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:47.812792 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:47.813120 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:47.813125 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:47.813871 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:47.814140 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:47.814146 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:47.815163 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:47.815164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:47.816228 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:47.816231 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:47.816775 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:47.816776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:47.816915 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:47.817677 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:47.817688 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:47.819579 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:47.821691 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:47.821706 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:47.821709 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:47.822109 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:47.822474 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:47.822476 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:47.822477 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:47.822770 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:47.823150 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:47.823160 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:47.823417 (+ 257us) client_negotiation.cc:769] Sending connection context
0806 13:04:47.823574 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 13:04:47.823844 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":120,"threads_started":1}
I20260806 13:04:47.824928 4898 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46585
I20260806 13:04:47.825083 4898 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:47.825369 4898 heartbeater.cc:511] Master 127.20.245.190:46585 requested a full tablet report, sending...
I20260806 13:04:47.826092 4703 ts_manager.cc:194] Registered new tserver with Master: 5f922b86e15140b88073be8859f17d41 (127.20.245.129:34603)
I20260806 13:04:47.827046 4703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:51697
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:04:47.855603 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46585
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:47.952593 4903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:47.952874 4903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:47.952905 4903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:47.954312 4903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:47.954380 4903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:47.954416 4903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:04:47.956262 4903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:47.956588 4903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:47.956892 4903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:47.963392 4908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:47.963404 4911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:47.963428 4903 server_base.cc:1034] running on GCE node
W20260806 13:04:47.963433 4909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:47.964056 4903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:47.964396 4903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:47.965579 4903 hybrid_clock.cc:648] HybridClock initialized: now 1786021487965633 us; error 102 us; skew 500 ppm
Aug 06 13:04:47 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:47.968894 4903 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:04:47.969422 4903 webserver.cc:460] Webserver started at http://127.20.245.130:39247/ using document root <none> and password file <none>
I20260806 13:04:47.969689 4903 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:47.969743 4903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:47.969861 4903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:47.971299 4903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "16de750822344feb9c125de4aaa7f494"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b6ceb764b21231b5a9e703279a832fb"
server_key_iv: "cfd0d24fa1c860d910ae3d6657d24f71"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.971719 4903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "16de750822344feb9c125de4aaa7f494"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b6ceb764b21231b5a9e703279a832fb"
server_key_iv: "cfd0d24fa1c860d910ae3d6657d24f71"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.973505 4903 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 13:04:47.974558 4919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:47.974782 4903 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:47.974880 4903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "16de750822344feb9c125de4aaa7f494"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b6ceb764b21231b5a9e703279a832fb"
server_key_iv: "cfd0d24fa1c860d910ae3d6657d24f71"
server_key_version: "encryptionkey@0"
I20260806 13:04:47.974952 4903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:47.988785 4903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:47.991470 4903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:47.991628 4903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:47.991909 4903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:47.992415 4903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:47.992457 4903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:47.992487 4903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:47.992501 4903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:48.000012 4903 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:34055
I20260806 13:04:48.000129 5034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:34055 every 8 connection(s)
I20260806 13:04:48.000572 4903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:04:48.003204 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 4903
I20260806 13:04:48.003404 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:04:48.003734 21462 external_mini_cluster.cc:1428] Setting key 3146c15c610b093170b45a18538218d1
Aug 06 13:04:48 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021487, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:48.014335 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.001890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:55467 (local address 127.20.245.190:46585)
0806 13:04:48.001999 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.002002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.002324 (+ 322us) server_negotiation.cc:407] Connection header received
0806 13:04:48.002905 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.002907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.002925 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.003005 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:48.004651 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.005418 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.006724 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.006947 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.007046 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.010239 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:48.010241 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:48.010242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:48.010259 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:48.012421 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:48.012986 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:48.012987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:48.012988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:48.013086 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:48.013456 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:48.013457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:48.013458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:48.013644 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:48.013725 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.014067 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.014185 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 13:04:48.014585 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.001798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:55467)
0806 13:04:48.002050 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:48.002105 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:48.002756 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:48.003155 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:48.003161 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:48.004156 (+ 995us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:48.004523 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.004538 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.005567 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.005569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.006586 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.006589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.007064 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.007065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.007299 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.008039 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:48.008054 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:48.010101 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:48.012543 (+ 2442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:48.012554 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:48.012557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:48.012889 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:48.013208 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:48.013209 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:48.013209 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:48.013371 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:48.013721 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:48.013728 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:48.013909 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 13:04:48.014020 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 13:04:48.014207 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
I20260806 13:04:48.015375 5035 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46585
I20260806 13:04:48.015518 5035 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:48.015765 5035 heartbeater.cc:511] Master 127.20.245.190:46585 requested a full tablet report, sending...
I20260806 13:04:48.016356 4703 ts_manager.cc:194] Registered new tserver with Master: 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055)
I20260806 13:04:48.016876 4703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:55467
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:04:48.039793 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46585
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:04:48.142915 5040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:04:48.143308 5040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:04:48.143361 5040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:04:48.144897 5040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:04:48.145002 5040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:04:48.145058 5040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:04:48.147010 5040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:04:48.147426 5040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:04:48.147759 5040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:04:48.154261 5048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:48.154276 5045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:04:48.154277 5046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:04:48.154695 5040 server_base.cc:1034] running on GCE node
I20260806 13:04:48.155031 5040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:04:48.155432 5040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:04:48.156638 5040 hybrid_clock.cc:648] HybridClock initialized: now 1786021488156603 us; error 48 us; skew 500 ppm
Aug 06 13:04:48 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021488, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:04:48.160013 5040 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:04:48.160637 5040 webserver.cc:460] Webserver started at http://127.20.245.131:40111/ using document root <none> and password file <none>
I20260806 13:04:48.160925 5040 fs_manager.cc:359] Metadata directory not provided
I20260806 13:04:48.160979 5040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:04:48.161140 5040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:04:48.162534 5040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "2914185499de492c8be5e7f3f0cc06b4"
format_stamp: "Formatted at 2026-08-06 13:04:48 on dist-test-slave-srgv"
server_key: "6ffbd24c1b082044970b497c0c6064d0"
server_key_iv: "6874453208f729993860453dc1cedf9a"
server_key_version: "encryptionkey@0"
I20260806 13:04:48.162971 5040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "2914185499de492c8be5e7f3f0cc06b4"
format_stamp: "Formatted at 2026-08-06 13:04:48 on dist-test-slave-srgv"
server_key: "6ffbd24c1b082044970b497c0c6064d0"
server_key_iv: "6874453208f729993860453dc1cedf9a"
server_key_version: "encryptionkey@0"
I20260806 13:04:48.165028 5040 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260806 13:04:48.166278 5055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:48.166581 5040 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:04:48.166710 5040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "2914185499de492c8be5e7f3f0cc06b4"
format_stamp: "Formatted at 2026-08-06 13:04:48 on dist-test-slave-srgv"
server_key: "6ffbd24c1b082044970b497c0c6064d0"
server_key_iv: "6874453208f729993860453dc1cedf9a"
server_key_version: "encryptionkey@0"
I20260806 13:04:48.166843 5040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:04:48.186098 5040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:04:48.189342 5040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:04:48.189546 5040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:04:48.189909 5040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:04:48.190418 5040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:04:48.190510 5040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:48.190564 5040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:04:48.190610 5040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:04:48.198243 5040 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:34803
I20260806 13:04:48.198274 5173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:34803 every 8 connection(s)
I20260806 13:04:48.198774 5040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
Aug 06 13:04:48 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021488, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:04:48.207705 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 5040
I20260806 13:04:48.207859 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:04:48.208112 21462 external_mini_cluster.cc:1428] Setting key 45d1f86631220a6ebd216356264a4efa
I20260806 13:04:48.210785 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.199883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:36529 (local address 127.20.245.190:46585)
0806 13:04:48.200025 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.200028 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.200261 (+ 233us) server_negotiation.cc:407] Connection header received
0806 13:04:48.200909 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.200910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.200928 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.200998 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:48.202250 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.202830 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.204093 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.204337 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.204436 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.207235 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:48.207241 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:48.207242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:48.207251 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:48.209119 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:48.209648 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:48.209650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:48.209650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:48.209723 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:48.210009 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:48.210011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:48.210011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:48.210152 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:48.210244 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.210558 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.210669 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 13:04:48.211071 5176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.199768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:36529)
0806 13:04:48.200039 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:48.200099 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:48.200772 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:48.201090 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:48.201096 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:48.201845 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:04:48.202103 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.202109 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.202966 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.202968 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.203985 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.203989 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.204454 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.204456 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.204605 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.205308 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:04:48.205319 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:04:48.207030 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:04:48.209217 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:48.209229 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:48.209238 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:48.209565 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:48.209799 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:04:48.209800 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:04:48.209800 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:04:48.209936 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:04:48.210223 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:04:48.210231 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:04:48.210405 (+ 174us) client_negotiation.cc:769] Sending connection context
0806 13:04:48.210526 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 13:04:48.210753 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":112,"threads_started":1}
I20260806 13:04:48.211752 5174 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46585
I20260806 13:04:48.211859 5174 heartbeater.cc:464] Registering TS with master...
I20260806 13:04:48.212047 5174 heartbeater.cc:511] Master 127.20.245.190:46585 requested a full tablet report, sending...
I20260806 13:04:48.212546 4703 ts_manager.cc:194] Registered new tserver with Master: 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803)
I20260806 13:04:48.212953 4703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:36529
I20260806 13:04:48.220736 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:04:48.230406 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.222510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40660 (local address 127.20.245.190:46585)
0806 13:04:48.222587 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.222589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.222718 (+ 129us) server_negotiation.cc:407] Connection header received
0806 13:04:48.222815 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.222816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.222836 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.222906 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:04:48.223672 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.224227 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.225028 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.225257 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.225338 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.226927 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:04:48.226929 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:04:48.226929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:04:48.226937 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:04:48.228901 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:48.229353 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:48.229355 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:48.229355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:48.229427 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:04:48.229642 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:04:48.229643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:04:48.229643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:04:48.229858 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:04:48.229980 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.230128 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.230267 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:04:48.232764 4703 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:04:48.234931 4703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:04:48.243412 5186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.238167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34603 (local address 127.0.0.1:45144)
0806 13:04:48.238404 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:48.238418 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:48.238493 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:48.239220 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:48.239221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:48.239224 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:48.239324 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.239326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.240691 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.240692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.241937 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.241941 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.242995 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.242996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.243098 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.243104 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:04:48.243161 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 13:04:48.243268 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":67,"thread_start_us":124,"threads_started":1}
I20260806 13:04:48.243492 5188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.238494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55418 (local address 127.20.245.131:34803)
0806 13:04:48.238738 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.238744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.238755 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:04:48.238827 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.238830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.238850 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.238947 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:48.239213 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.240477 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.242303 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.243070 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.243156 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.243269 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.243330 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.243378 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":131,"threads_started":1}
I20260806 13:04:48.243644 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.238795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54820 (local address 127.20.245.130:34055)
0806 13:04:48.239128 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.239132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.239449 (+ 317us) server_negotiation.cc:407] Connection header received
0806 13:04:48.239530 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.239533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.239550 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.239656 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:48.239821 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.240539 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.242318 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.242864 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.242971 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.243055 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.243464 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.243533 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":87,"threads_started":1}
I20260806 13:04:48.243872 5187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.238466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:34055 (local address 127.0.0.1:54820)
0806 13:04:48.239352 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:48.239362 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:48.239449 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:48.239654 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:48.239654 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:48.239656 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:48.239750 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.239752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.240691 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.240692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.242189 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.242193 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.242970 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.242971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.243079 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.243098 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 13:04:48.243206 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 13:04:48.243274 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"mutex_wait_us":82,"thread_start_us":91,"threads_started":1}
I20260806 13:04:48.244033 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.238681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45144 (local address 127.20.245.129:34603)
0806 13:04:48.238984 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.238988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.238999 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:04:48.239046 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.239048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.239066 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.239408 (+ 342us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:48.239508 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.240585 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.242058 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.242881 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.243724 (+ 843us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.243826 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.243851 (+ 25us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.243898 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":117,"threads_started":1}
I20260806 13:04:48.243412 5185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.238163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:34803 (local address 127.0.0.1:55418)
0806 13:04:48.238352 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:48.238407 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:48.238493 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:48.238961 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:48.238966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:48.238969 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:48.239074 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.239078 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.240625 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.240627 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.242190 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.242193 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.243149 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.243150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.243251 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.243255 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:04:48.243309 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 13:04:48.243350 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":150,"thread_start_us":120,"threads_started":1}
I20260806 13:04:48.244809 4831 tablet_service.cc:1467] Processing CreateTablet for tablet dcd15968fd67496caa53faec0e78d333 (DEFAULT_TABLE table=test-table [id=1b4c988d868b4e1bbf1aa53689baf7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:48.244820 4967 tablet_service.cc:1467] Processing CreateTablet for tablet dcd15968fd67496caa53faec0e78d333 (DEFAULT_TABLE table=test-table [id=1b4c988d868b4e1bbf1aa53689baf7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:48.244946 5107 tablet_service.cc:1467] Processing CreateTablet for tablet dcd15968fd67496caa53faec0e78d333 (DEFAULT_TABLE table=test-table [id=1b4c988d868b4e1bbf1aa53689baf7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:04:48.245260 5107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcd15968fd67496caa53faec0e78d333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:48.245261 4831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcd15968fd67496caa53faec0e78d333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:48.245261 4967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcd15968fd67496caa53faec0e78d333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:04:48.248628 5191 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: Bootstrap starting.
I20260806 13:04:48.249251 5192 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: Bootstrap starting.
I20260806 13:04:48.249655 5191 tablet_bootstrap.cc:654] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:48.249750 5193 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Bootstrap starting.
I20260806 13:04:48.249990 5192 tablet_bootstrap.cc:654] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:48.250408 5191 log.cc:824] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:48.250571 5193 tablet_bootstrap.cc:654] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Neither blocks nor log segments found. Creating new log.
I20260806 13:04:48.250770 5192 log.cc:824] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:48.251328 5193 log.cc:824] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Log is configured to *not* fsync() on all Append() calls
I20260806 13:04:48.251466 5191 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: No bootstrap required, opened a new log
I20260806 13:04:48.251566 5191 ts_tablet_manager.cc:1397] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:04:48.251698 5192 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: No bootstrap required, opened a new log
I20260806 13:04:48.251771 5192 ts_tablet_manager.cc:1397] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:04:48.252365 5193 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: No bootstrap required, opened a new log
I20260806 13:04:48.252506 5193 ts_tablet_manager.cc:1397] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 13:04:48.253561 5191 raft_consensus.cc:348] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.253784 5191 raft_consensus.cc:374] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:48.253834 5191 raft_consensus.cc:729] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2914185499de492c8be5e7f3f0cc06b4, State: Initialized, Role: FOLLOWER
I20260806 13:04:48.253970 5191 consensus_queue.cc:260] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.254343 5174 heartbeater.cc:503] Master 127.20.245.190:46585 was elected leader, sending a full tablet report...
I20260806 13:04:48.254349 5191 ts_tablet_manager.cc:1428] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:04:48.254281 5192 raft_consensus.cc:348] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.254469 5192 raft_consensus.cc:374] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:48.254508 5192 raft_consensus.cc:729] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16de750822344feb9c125de4aaa7f494, State: Initialized, Role: FOLLOWER
I20260806 13:04:48.254647 5192 consensus_queue.cc:260] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.255061 5192 ts_tablet_manager.cc:1428] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:04:48.255002 5193 raft_consensus.cc:348] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.255281 5035 heartbeater.cc:503] Master 127.20.245.190:46585 was elected leader, sending a full tablet report...
I20260806 13:04:48.255306 5193 raft_consensus.cc:374] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:04:48.255359 5193 raft_consensus.cc:729] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f922b86e15140b88073be8859f17d41, State: Initialized, Role: FOLLOWER
I20260806 13:04:48.255492 5193 consensus_queue.cc:260] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.255851 5193 ts_tablet_manager.cc:1428] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:04:48.255857 4898 heartbeater.cc:503] Master 127.20.245.190:46585 was elected leader, sending a full tablet report...
W20260806 13:04:48.311980 4899 tablet.cc:2369] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:04:48.395499 5199 raft_consensus.cc:482] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:04:48.395776 5199 raft_consensus.cc:504] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.396368 5199 leader_election.cc:288] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803), 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055)
I20260806 13:04:48.400699 5188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.396915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:46745 (local address 127.20.245.131:34803)
0806 13:04:48.397004 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.397007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.397280 (+ 273us) server_negotiation.cc:407] Connection header received
0806 13:04:48.397334 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.397336 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.397351 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.397415 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:48.397700 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.398302 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.399786 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.400233 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.400302 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.400312 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.400527 (+ 215us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.400587 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:04:48.400743 5200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.396794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:34803 (local address 127.20.245.129:46745)
0806 13:04:48.397004 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:48.397019 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:48.397109 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:48.397447 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:48.397449 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:48.397452 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:48.397577 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.397580 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.398422 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.398423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.399634 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.399638 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.400336 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.400337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.400433 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.400438 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:04:48.400508 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 13:04:48.400553 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":140,"threads_started":1}
I20260806 13:04:48.400800 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.397335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:48513 (local address 127.20.245.130:34055)
0806 13:04:48.397422 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.397424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.397436 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:04:48.397470 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.397471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.397487 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.397562 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:04:48.397914 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.398634 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.399838 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.400336 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.400429 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.400439 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.400638 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.400698 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 13:04:48.400748 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.397101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:34055 (local address 127.20.245.129:48513)
0806 13:04:48.397290 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:48.397303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:04:48.397384 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:04:48.397689 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:04:48.397690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:04:48.397693 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:04:48.397790 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.397793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.398812 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.398813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.399692 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:04:48.399695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.400443 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.400444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:04:48.400541 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.400546 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:04:48.400606 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:04:48.400647 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":93,"threads_started":1}
I20260806 13:04:48.401367 4988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcd15968fd67496caa53faec0e78d333" candidate_uuid: "5f922b86e15140b88073be8859f17d41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16de750822344feb9c125de4aaa7f494" is_pre_election: true
I20260806 13:04:48.401373 5127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcd15968fd67496caa53faec0e78d333" candidate_uuid: "5f922b86e15140b88073be8859f17d41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2914185499de492c8be5e7f3f0cc06b4" is_pre_election: true
I20260806 13:04:48.401635 5127 raft_consensus.cc:2454] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f922b86e15140b88073be8859f17d41 in term 0.
I20260806 13:04:48.401635 4988 raft_consensus.cc:2454] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f922b86e15140b88073be8859f17d41 in term 0.
I20260806 13:04:48.402007 4786 leader_election.cc:302] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16de750822344feb9c125de4aaa7f494, 5f922b86e15140b88073be8859f17d41; no voters:
I20260806 13:04:48.402225 5199 raft_consensus.cc:2781] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:04:48.402352 5199 raft_consensus.cc:482] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:04:48.402400 5199 raft_consensus.cc:3037] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:48.403578 5199 raft_consensus.cc:504] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.403810 5199 leader_election.cc:288] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 1 election: Requested vote from peers 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803), 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055)
I20260806 13:04:48.404158 4988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcd15968fd67496caa53faec0e78d333" candidate_uuid: "5f922b86e15140b88073be8859f17d41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16de750822344feb9c125de4aaa7f494"
I20260806 13:04:48.404211 5127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcd15968fd67496caa53faec0e78d333" candidate_uuid: "5f922b86e15140b88073be8859f17d41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2914185499de492c8be5e7f3f0cc06b4"
I20260806 13:04:48.404274 4988 raft_consensus.cc:3037] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:48.404402 5127 raft_consensus.cc:3037] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:04:48.405301 4988 raft_consensus.cc:2454] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f922b86e15140b88073be8859f17d41 in term 1.
I20260806 13:04:48.405447 5127 raft_consensus.cc:2454] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f922b86e15140b88073be8859f17d41 in term 1.
I20260806 13:04:48.405536 4786 leader_election.cc:302] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16de750822344feb9c125de4aaa7f494, 5f922b86e15140b88073be8859f17d41; no voters:
I20260806 13:04:48.405741 5199 raft_consensus.cc:2781] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:04:48.405941 5199 raft_consensus.cc:686] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 1 LEADER]: Becoming Leader. State: Replica: 5f922b86e15140b88073be8859f17d41, State: Running, Role: LEADER
I20260806 13:04:48.406075 5199 consensus_queue.cc:237] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:04:48.407388 4702 catalog_manager.cc:5495] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f922b86e15140b88073be8859f17d41 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "5f922b86e15140b88073be8859f17d41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } health_report { overall_health: UNKNOWN } } }
I20260806 13:04:48.432228 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.428787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45148 (local address 127.20.245.129:34603)
0806 13:04:48.428855 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 13:04:48.428857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:04:48.428867 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:04:48.428956 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:04:48.428957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:04:48.428985 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:04:48.429053 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:04:48.429294 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.429833 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.431141 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:04:48.431523 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:04:48.431608 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:04:48.431790 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:04:48.431948 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:04:48.432056 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 13:04:48.432074 (+ 18us) server_negotiation.cc:299] Negotiation successful
0806 13:04:48.432110 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 13:04:48.435077 5127 raft_consensus.cc:1261] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 FOLLOWER]: Refusing update from remote peer 5f922b86e15140b88073be8859f17d41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:48.435159 4988 raft_consensus.cc:1261] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 1 FOLLOWER]: Refusing update from remote peer 5f922b86e15140b88073be8859f17d41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:04:48.435647 5202 consensus_queue.cc:1035] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:48.435848 5199 consensus_queue.cc:1035] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:04:48.439384 5207 mvcc.cc:205] Tried to move back new op lower bound from 7315544016625278976 to 7315544016512135168. Current Snapshot: MvccSnapshot[applied={T|T < 7315544016625278976}]
I20260806 13:04:48.439436 5206 mvcc.cc:205] Tried to move back new op lower bound from 7315544016625278976 to 7315544016512135168. Current Snapshot: MvccSnapshot[applied={T|T < 7315544016625278976}]
I20260806 13:04:48.442444 4702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:04:48.442584 4702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:04:48.443708 4702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Sending DeleteTablet for 3 replicas of tablet dcd15968fd67496caa53faec0e78d333
I20260806 13:04:48.444205 5107 tablet_service.cc:1514] Processing DeleteTablet for tablet dcd15968fd67496caa53faec0e78d333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:48 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:55418
I20260806 13:04:48.444272 4967 tablet_service.cc:1514] Processing DeleteTablet for tablet dcd15968fd67496caa53faec0e78d333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:48 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:54820
I20260806 13:04:48.444679 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 4767
I20260806 13:04:48.444679 4831 tablet_service.cc:1514] Processing DeleteTablet for tablet dcd15968fd67496caa53faec0e78d333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:48 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:45144
I20260806 13:04:48.446830 5215 tablet_replica.cc:330] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: stopping tablet replica
I20260806 13:04:48.447058 5215 raft_consensus.cc:2229] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:48.447307 5215 raft_consensus.cc:2258] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:48.447614 5216 tablet_replica.cc:330] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: stopping tablet replica
I20260806 13:04:48.447801 5216 raft_consensus.cc:2229] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:04:48.447966 5216 raft_consensus.cc:2258] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:04:48.448752 5216 ts_tablet_manager.cc:1905] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:04:48.448752 5215 ts_tablet_manager.cc:1905] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:04:48.451045 5216 ts_tablet_manager.cc:1918] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:04:48.451045 5215 ts_tablet_manager.cc:1918] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:04:48.451244 5215 log.cc:1196] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/dcd15968fd67496caa53faec0e78d333
I20260806 13:04:48.451282 5216 log.cc:1196] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/dcd15968fd67496caa53faec0e78d333
I20260806 13:04:48.451607 5215 ts_tablet_manager.cc:1939] T dcd15968fd67496caa53faec0e78d333 P 2914185499de492c8be5e7f3f0cc06b4: Deleting consensus metadata
I20260806 13:04:48.451632 5216 ts_tablet_manager.cc:1939] T dcd15968fd67496caa53faec0e78d333 P 16de750822344feb9c125de4aaa7f494: Deleting consensus metadata
I20260806 13:04:48.452216 4690 catalog_manager.cc:4841] TS 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803): tablet dcd15968fd67496caa53faec0e78d333 (table test-table [id=1b4c988d868b4e1bbf1aa53689baf7cf]) successfully deleted
W20260806 13:04:48.452302 4688 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:34603 (error 108)
I20260806 13:04:48.452817 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 4903
I20260806 13:04:48.453001 5185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:04:48.452829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34603 (local address 127.0.0.1:45156)
0806 13:04:48.452903 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 13:04:48.452953 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:34603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 13:04:48.453888 4690 catalog_manager.cc:4841] TS 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055): tablet dcd15968fd67496caa53faec0e78d333 (table test-table [id=1b4c988d868b4e1bbf1aa53689baf7cf]) successfully deleted
W20260806 13:04:48.454182 4688 catalog_manager.cc:4584] TS 5f922b86e15140b88073be8859f17d41 (127.20.245.129:34603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dcd15968fd67496caa53faec0e78d333: Network error: Client connection negotiation failed: client connection to 127.20.245.129:34603: connect: Connection refused (error 111)
I20260806 13:04:48.459128 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 5040
I20260806 13:04:48.466187 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 4671
I20260806 13:05:08.474145 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46585
--webserver_interface=127.20.245.190
--webserver_port=39025
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:46585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:08.566689 5218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:08.566943 5218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:08.566977 5218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:08.568521 5218 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 13:05:08.568602 5218 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 13:05:08.568619 5218 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 13:05:08.568632 5218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:08.568646 5218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:08.568662 5218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:08.568675 5218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:08.568688 5218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:08.570550 5218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:46585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=39025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:08.570871 5218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:08.571278 5218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:08.582324 5227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:08.582244 5224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:08.582244 5225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:08.582746 5218 server_base.cc:1034] running on GCE node
I20260806 13:05:08.583323 5218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:08.583802 5218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:08.585012 5218 hybrid_clock.cc:648] HybridClock initialized: now 1786021508584977 us; error 54 us; skew 500 ppm
Aug 06 13:05:08 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021508, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:08.588877 5218 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:05:08.589591 5218 webserver.cc:460] Webserver started at http://127.20.245.190:39025/ using document root <none> and password file <none>
I20260806 13:05:08.589929 5218 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:08.590035 5218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:08.593065 5218 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:08.594194 5234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:08.594542 5218 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:08.594681 5218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "d1d6070122ad46998a070d44aa4b8c90"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b47b6fdeec4f97c167a1f02a5742545"
server_key_iv: "a2d614e7c178c22c5a41853e28da99fe"
server_key_version: "encryptionkey@0"
I20260806 13:05:08.595398 5218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:08.639595 5218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:08.642406 5218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:08.642562 5218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:08.648763 5218 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:46585
I20260806 13:05:08.648857 5287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:46585 every 8 connection(s)
I20260806 13:05:08.649396 5218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:08.651438 5288 sys_catalog.cc:263] Verifying existing consensus state
I20260806 13:05:08.652227 5288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Bootstrap starting.
I20260806 13:05:08.652946 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 5218
I20260806 13:05:08.653317 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:34603
--local_ip_for_outbound_sockets=127.20.245.129
--tserver_master_addrs=127.20.245.190:46585
--webserver_port=43159
--webserver_interface=127.20.245.129
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:05:08.662392 5288 log.cc:824] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:08.664644 5288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:05:08.665020 5288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Bootstrap complete.
I20260806 13:05:08.667618 5288 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:05:08.667894 5288 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d6070122ad46998a070d44aa4b8c90, State: Initialized, Role: FOLLOWER
I20260806 13:05:08.668120 5288 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:05:08.668220 5288 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:08.668277 5288 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:08.668350 5288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 1 FOLLOWER]: Advancing to term 2
I20260806 13:05:08.669490 5288 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:05:08.669589 5288 leader_election.cc:302] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1d6070122ad46998a070d44aa4b8c90; no voters:
I20260806 13:05:08.669845 5288 leader_election.cc:288] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 13:05:08.669886 5292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 13:05:08.670035 5292 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 2 LEADER]: Becoming Leader. State: Replica: d1d6070122ad46998a070d44aa4b8c90, State: Running, Role: LEADER
I20260806 13:05:08.670177 5288 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:08.670254 5292 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:05:08.670935 5294 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1d6070122ad46998a070d44aa4b8c90. Latest consensus state: current_term: 2 leader_uuid: "d1d6070122ad46998a070d44aa4b8c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } } }
I20260806 13:05:08.670953 5293 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d1d6070122ad46998a070d44aa4b8c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } } }
I20260806 13:05:08.671092 5294 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:08.671147 5293 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:08.672021 5299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:08.673307 5299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:08.673429 5299 catalog_manager.cc:1259] Loaded cluster ID: 2a32ffa137344f2790ffae4a8d34ed93
I20260806 13:05:08.673456 5299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:05:08.674924 5299 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:08.675158 5299 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Loaded TSK: 0
I20260806 13:05:08.690959 5299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Generated new TSK 1
I20260806 13:05:08.691128 5299 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 13:05:08.761868 5290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:08.762233 5290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:08.762285 5290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:08.763973 5290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:08.764086 5290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:08.764143 5290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:05:08.766266 5290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:34603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=43159
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:08.766688 5290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:08.767038 5290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:08.774675 5319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:08.774688 5316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:08.774748 5317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:08.775403 5290 server_base.cc:1034] running on GCE node
I20260806 13:05:08.775709 5290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:08.776081 5290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:08.777284 5290 hybrid_clock.cc:648] HybridClock initialized: now 1786021508777258 us; error 50 us; skew 500 ppm
Aug 06 13:05:08 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021508, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:08.780964 5290 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:05:08.781656 5290 webserver.cc:460] Webserver started at http://127.20.245.129:43159/ using document root <none> and password file <none>
I20260806 13:05:08.781985 5290 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:08.782102 5290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:08.784149 5290 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 13:05:08.785130 5326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:08.785425 5290 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:08.785568 5290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "5f922b86e15140b88073be8859f17d41"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "a6637fa3d089e01ca0bc9498f976b6e6"
server_key_iv: "c7d158065091e11bcfebb4a7f3d0e391"
server_key_version: "encryptionkey@0"
I20260806 13:05:08.786067 5290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:08.803031 5290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:08.806208 5290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:08.806434 5290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:08.806756 5290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:08.807448 5333 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 13:05:08.809252 5290 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 13:05:08.809319 5290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 13:05:08.809352 5290 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 13:05:08.810186 5290 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 13:05:08.810246 5290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 13:05:08.810295 5333 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Bootstrap starting.
I20260806 13:05:08.820719 5290 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:34603
I20260806 13:05:08.820868 5441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:34603 every 8 connection(s)
I20260806 13:05:08.821919 5290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:05:08.825930 5333 log.cc:824] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:08.829210 5333 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:05:08.829658 5333 tablet_bootstrap.cc:492] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Bootstrap complete.
I20260806 13:05:08.831164 5333 ts_tablet_manager.cc:1397] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.009s
I20260806 13:05:08.831396 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 5290
I20260806 13:05:08.831797 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:34055
--local_ip_for_outbound_sockets=127.20.245.130
--tserver_master_addrs=127.20.245.190:46585
--webserver_port=39247
--webserver_interface=127.20.245.130
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:05:08.833545 5333 raft_consensus.cc:348] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:05:08.834095 5333 raft_consensus.cc:729] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f922b86e15140b88073be8859f17d41, State: Initialized, Role: FOLLOWER
I20260806 13:05:08.834362 5333 consensus_queue.cc:260] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } } peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } }
I20260806 13:05:08.834776 5333 ts_tablet_manager.cc:1428] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
Aug 06 13:05:08 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021508, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:08.844457 5446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:08.823445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:51653 (local address 127.20.245.190:46585)
0806 13:05:08.823716 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:08.823729 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:08.826572 (+ 2843us) server_negotiation.cc:407] Connection header received
0806 13:05:08.827607 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:08.827616 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:08.827708 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:08.827903 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:08.828950 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.830777 (+ 1827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.833593 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.834765 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.834953 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:08.838915 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:08.838922 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:08.838923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:08.838941 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:08.841618 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:08.842443 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:08.842449 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:08.842449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:08.842603 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:08.843032 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:08.843033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:08.843033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:08.843432 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:08.843531 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:08.844016 (+ 485us) server_negotiation.cc:299] Negotiation successful
0806 13:05:08.844206 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":102,"threads_started":1}
I20260806 13:05:08.844524 5445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:08.823334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:51653)
0806 13:05:08.826263 (+ 2929us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:08.826335 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:08.827294 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:08.827959 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:08.827964 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:08.828420 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:08.828775 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:08.828784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.830952 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.830954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:08.833409 (+ 2455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:08.833415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.835137 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.835138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:08.835348 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:08.836233 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:08.836257 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:08.838743 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:08.841771 (+ 3028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:08.841790 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:08.841794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:08.842293 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:08.842727 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:08.842728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:08.842729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:08.842927 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:08.843521 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:08.843533 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:08.843763 (+ 230us) client_negotiation.cc:769] Sending connection context
0806 13:05:08.843913 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 13:05:08.844214 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2858,"thread_start_us":140,"threads_started":1}
I20260806 13:05:08.846149 5443 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46585
I20260806 13:05:08.846315 5443 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:08.846596 5443 heartbeater.cc:511] Master 127.20.245.190:46585 requested a full tablet report, sending...
I20260806 13:05:08.847720 5251 ts_manager.cc:194] Registered new tserver with Master: 5f922b86e15140b88073be8859f17d41 (127.20.245.129:34603)
I20260806 13:05:08.849020 5251 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:51653
I20260806 13:05:08.850346 5443 heartbeater.cc:503] Master 127.20.245.190:46585 was elected leader, sending a full tablet report...
Aug 06 13:05:08 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021508, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.129@KRBTEST.COM
I20260806 13:05:08.859997 5450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:08.848560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34603 (local address 127.0.0.1:60882)
0806 13:05:08.849425 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:08.849467 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:08.849552 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:08.849929 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:08.849936 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:08.850484 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:08.850566 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:08.850569 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.851707 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.851709 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:08.852879 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:08.852883 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.853427 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.853428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:08.853517 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:08.854172 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:08.854179 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:08.856209 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:08.858475 (+ 2266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:08.858497 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:08.858500 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:08.858764 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:08.859019 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:08.859020 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:08.859020 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:08.859099 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:08.859501 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:08.859510 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:08.859576 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 13:05:08.859690 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 13:05:08.859870 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"thread_start_us":137,"threads_started":1}
I20260806 13:05:08.859988 5451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:08.848673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60882 (local address 127.20.245.129:34603)
0806 13:05:08.849744 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:08.849749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:08.849761 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:05:08.849803 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:08.849805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:08.849822 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:08.849907 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:08.850645 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.851622 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.852979 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.853342 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.853406 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:08.856333 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:08.856349 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:08.856349 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:08.856367 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:08.858358 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:08.858865 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:08.858876 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:08.858877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:08.858942 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:08.859198 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:08.859199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:08.859200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:08.859402 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:08.859527 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:08.859733 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 13:05:08.859853 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1027,"thread_start_us":119,"threads_started":1}
I20260806 13:05:08.860527 5376 tablet_service.cc:1514] Processing DeleteTablet for tablet dcd15968fd67496caa53faec0e78d333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:04:48 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:60882
I20260806 13:05:08.861227 5452 tablet_replica.cc:330] stopping tablet replica
I20260806 13:05:08.861380 5452 raft_consensus.cc:2229] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:08.861476 5452 raft_consensus.cc:2258] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:08.861917 5452 ts_tablet_manager.cc:1905] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:08.864975 5452 ts_tablet_manager.cc:1918] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:08.865082 5452 log.cc:1196] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal/wals/dcd15968fd67496caa53faec0e78d333
I20260806 13:05:08.865361 5452 ts_tablet_manager.cc:1939] T dcd15968fd67496caa53faec0e78d333 P 5f922b86e15140b88073be8859f17d41: Deleting consensus metadata
I20260806 13:05:08.866103 5236 catalog_manager.cc:4841] TS 5f922b86e15140b88073be8859f17d41 (127.20.245.129:34603): tablet dcd15968fd67496caa53faec0e78d333 (table test-table [id=1b4c988d868b4e1bbf1aa53689baf7cf]) successfully deleted
W20260806 13:05:08.941685 5448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:08.942011 5448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:08.942044 5448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:08.943593 5448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:08.943660 5448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:08.943746 5448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:05:08.945669 5448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:34055
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=39247
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:08.946064 5448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:08.946381 5448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:08.952935 5458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:08.952935 5457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:08.953230 5448 server_base.cc:1034] running on GCE node
W20260806 13:05:08.952948 5460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:08.953711 5448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:08.953998 5448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:08.955272 5448 hybrid_clock.cc:648] HybridClock initialized: now 1786021508955275 us; error 64 us; skew 500 ppm
Aug 06 13:05:08 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021508, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:08.958788 5448 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:05:08.959579 5448 webserver.cc:460] Webserver started at http://127.20.245.130:39247/ using document root <none> and password file <none>
I20260806 13:05:08.959903 5448 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:08.959988 5448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:08.961762 5448 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:05:08.962677 5467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:08.962932 5448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:08.963058 5448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "16de750822344feb9c125de4aaa7f494"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b6ceb764b21231b5a9e703279a832fb"
server_key_iv: "cfd0d24fa1c860d910ae3d6657d24f71"
server_key_version: "encryptionkey@0"
I20260806 13:05:08.963657 5448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:08.978678 5448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:08.981616 5448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:08.981845 5448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:08.982168 5448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:08.982757 5448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:08.982831 5448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:08.982882 5448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:08.982916 5448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:08.991580 5448 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:34055
I20260806 13:05:08.991659 5582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:34055 every 8 connection(s)
I20260806 13:05:08.992167 5448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
Aug 06 13:05:08 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021508, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:09.000787 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 5448
I20260806 13:05:09.001230 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:34803
--local_ip_for_outbound_sockets=127.20.245.131
--tserver_master_addrs=127.20.245.190:46585
--webserver_port=40111
--webserver_interface=127.20.245.131
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:05:09.006767 5446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:08.993408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:55701 (local address 127.20.245.190:46585)
0806 13:05:08.993500 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:08.993503 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:08.993632 (+ 129us) server_negotiation.cc:407] Connection header received
0806 13:05:08.994342 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:08.994343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:08.994362 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:08.994427 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:08.995777 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.996372 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.997751 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.998001 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.998081 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.002386 (+ 4305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:09.002390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:09.002390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:09.002404 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:09.004677 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:09.005326 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:09.005328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:09.005329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:09.005421 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:09.005792 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:09.005793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:09.005793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:09.005987 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:09.006067 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.006467 (+ 400us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.006609 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 13:05:09.007279 5586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:08.993217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:55701)
0806 13:05:08.993465 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:08.993531 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:08.994199 (+ 668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:08.994520 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:08.994524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:08.995385 (+ 861us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:08.995658 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:08.995664 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.996503 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.996505 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:08.997635 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:08.997639 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:08.998144 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:08.998146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:08.998349 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:08.999367 (+ 1018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:08.999380 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:09.002161 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:09.004818 (+ 2657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:09.004839 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:09.004843 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:09.005204 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:09.005545 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:09.005546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:09.005546 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:09.005704 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:09.006094 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:09.006103 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:09.006294 (+ 191us) client_negotiation.cc:769] Sending connection context
0806 13:05:09.006420 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 13:05:09.006627 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":100,"threads_started":1}
I20260806 13:05:09.008174 5583 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46585
I20260806 13:05:09.008373 5583 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:09.008675 5583 heartbeater.cc:511] Master 127.20.245.190:46585 requested a full tablet report, sending...
I20260806 13:05:09.009342 5251 ts_manager.cc:194] Registered new tserver with Master: 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055)
I20260806 13:05:09.009809 5251 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:55701
W20260806 13:05:09.100725 5587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:09.101013 5587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:09.101044 5587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:09.102522 5587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:09.102592 5587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:09.102624 5587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:05:09.104583 5587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:34803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=40111
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:09.104930 5587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:09.105223 5587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:09.111598 5593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:09.111619 5595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:09.111598 5592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:09.111891 5587 server_base.cc:1034] running on GCE node
I20260806 13:05:09.112133 5587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:09.112439 5587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:09.113621 5587 hybrid_clock.cc:648] HybridClock initialized: now 1786021509113607 us; error 53 us; skew 500 ppm
Aug 06 13:05:09 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021509, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:09.116747 5587 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:05:09.117365 5587 webserver.cc:460] Webserver started at http://127.20.245.131:40111/ using document root <none> and password file <none>
I20260806 13:05:09.117671 5587 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:09.117771 5587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:09.119485 5587 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:05:09.120234 5602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:09.120455 5587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:09.120581 5587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "2914185499de492c8be5e7f3f0cc06b4"
format_stamp: "Formatted at 2026-08-06 13:04:48 on dist-test-slave-srgv"
server_key: "6ffbd24c1b082044970b497c0c6064d0"
server_key_iv: "6874453208f729993860453dc1cedf9a"
server_key_version: "encryptionkey@0"
I20260806 13:05:09.121124 5587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:09.141515 5587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:09.144618 5587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:09.144845 5587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:09.145205 5587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:09.145632 5587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:09.145694 5587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:09.145743 5587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:09.145794 5587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:09.153806 5587 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:34803
I20260806 13:05:09.153863 5716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:34803 every 8 connection(s)
I20260806 13:05:09.154325 5587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:05:09.160310 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 5587
Aug 06 13:05:09 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021509, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:09.166437 5446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.155374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:51325 (local address 127.20.245.190:46585)
0806 13:05:09.155453 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.155456 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.155686 (+ 230us) server_negotiation.cc:407] Connection header received
0806 13:05:09.156373 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.156375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.156391 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.156450 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:09.157641 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.158199 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.159445 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.159676 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.159769 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.163022 (+ 3253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:09.163024 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:09.163025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:09.163034 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:09.164819 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:09.165327 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:09.165329 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:09.165329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:09.165397 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:09.165679 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:09.165680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:09.165680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:09.165808 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:09.165884 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.166225 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.166326 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 13:05:09.166721 5719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.155348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:51325)
0806 13:05:09.155544 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:09.155589 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:09.156246 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:09.156533 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:09.156538 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:09.157257 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:09.157515 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.157522 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.158322 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.158323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.159339 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.159343 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.159782 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.159784 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.159949 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.160840 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:09.160855 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:09.162900 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:09.164925 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:09.164936 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:09.164939 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:09.165224 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:09.165467 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:09.165468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:09.165468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:09.165604 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:09.165874 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:09.165882 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:09.166063 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 13:05:09.166187 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 13:05:09.166397 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":81,"threads_started":1}
I20260806 13:05:09.167320 5717 heartbeater.cc:347] Connected to a master server at 127.20.245.190:46585
I20260806 13:05:09.167464 5717 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:09.167697 5717 heartbeater.cc:511] Master 127.20.245.190:46585 requested a full tablet report, sending...
I20260806 13:05:09.168236 5251 ts_manager.cc:194] Registered new tserver with Master: 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803)
I20260806 13:05:09.168517 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.160895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35922 (local address 127.20.245.190:46585)
0806 13:05:09.161062 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.161064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.161184 (+ 120us) server_negotiation.cc:407] Connection header received
0806 13:05:09.161282 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.161282 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.161294 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.161370 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:09.162164 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.162892 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.163828 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.164042 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.164121 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.165393 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:09.165395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:09.165395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:09.165403 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:09.167253 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:09.167676 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:09.167677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:09.167678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:09.167739 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:09.167953 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:09.167954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:09.167954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:09.168091 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:09.168277 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.168377 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.168448 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
I20260806 13:05:09.168825 5251 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:51325
I20260806 13:05:09.169540 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:05:09.173070 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.170010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35930 (local address 127.20.245.190:46585)
0806 13:05:09.170057 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.170060 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.170203 (+ 143us) server_negotiation.cc:407] Connection header received
0806 13:05:09.170310 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.170311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.170356 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.170428 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:05:09.170574 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.171162 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.172122 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.172380 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.172458 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.172638 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:05:09.172712 (+ 74us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 13:05:09.172989 (+ 277us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35930: token expired
Metrics: {"server-negotiator.queue_time_us":19}
W20260806 13:05:09.173151 5721 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35930: token expired
W20260806 13:05:09.173329 5179 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.245.190:46585)
I20260806 13:05:09.180014 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.173685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35942 (local address 127.20.245.190:46585)
0806 13:05:09.173726 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.173729 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.173737 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:05:09.173768 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.173770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.173783 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.173854 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:09.174365 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.174846 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.175606 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.175827 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.175895 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.177334 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:09.177336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:09.177337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:09.177345 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:09.178851 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:09.179260 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:09.179262 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:09.179262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:09.179336 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:09.179526 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:09.179526 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:09.179527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:09.179652 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:09.179740 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.179846 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.179929 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 13:05:09.181586 5251 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35942:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:05:09.184002 5251 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:05:09.187352 5376 tablet_service.cc:1467] Processing CreateTablet for tablet 42dcf2e24d1c454a8b8a0ad179e78287 (DEFAULT_TABLE table=test-table [id=c467e5be6ff84998a9f5f909e191552d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:09.187644 5376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42dcf2e24d1c454a8b8a0ad179e78287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:09.189543 5333 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Bootstrap starting.
I20260806 13:05:09.190025 5333 tablet_bootstrap.cc:654] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:09.190830 5333 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: No bootstrap required, opened a new log
I20260806 13:05:09.190901 5333 ts_tablet_manager.cc:1397] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:09.191424 5333 raft_consensus.cc:348] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.191527 5333 raft_consensus.cc:374] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:09.191596 5333 raft_consensus.cc:729] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f922b86e15140b88073be8859f17d41, State: Initialized, Role: FOLLOWER
I20260806 13:05:09.191665 5333 consensus_queue.cc:260] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.191777 5333 ts_tablet_manager.cc:1428] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:09.192320 5723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.186817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:34055 (local address 127.0.0.1:51974)
0806 13:05:09.186970 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:09.186981 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:09.187027 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:09.188000 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:09.188002 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:09.188005 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:09.188088 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.188091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.189701 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.189702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.191040 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.191043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.191994 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.191995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.192087 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.192124 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 13:05:09.192162 (+ 38us) client_negotiation.cc:240] Negotiation successful
0806 13:05:09.192218 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":82,"threads_started":1}
I20260806 13:05:09.192736 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.187491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51974 (local address 127.20.245.130:34055)
0806 13:05:09.187799 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.187805 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.187815 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:05:09.187861 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.187863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.187881 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.188202 (+ 321us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:09.188357 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.189596 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.191167 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.191884 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.192434 (+ 550us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.192543 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.192579 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.192633 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":132,"threads_started":1}
I20260806 13:05:09.193198 5450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.186688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:34803 (local address 127.0.0.1:35688)
0806 13:05:09.186806 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:09.186822 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:09.186876 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:09.188526 (+ 1650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:09.188528 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:09.188531 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:09.188599 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.188601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.190067 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.190067 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.191135 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.191137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.192945 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.192947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.193030 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.193034 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:09.193070 (+ 36us) client_negotiation.cc:240] Negotiation successful
0806 13:05:09.193134 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260806 13:05:09.193575 5724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.187232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35688 (local address 127.20.245.131:34803)
0806 13:05:09.187522 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.187528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.187543 (+ 15us) server_negotiation.cc:407] Connection header received
0806 13:05:09.187665 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.187670 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.187692 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.188719 (+ 1027us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:09.188897 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.189968 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.191310 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.192836 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.193322 (+ 486us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.193393 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.193423 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.193474 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":144,"threads_started":1}
I20260806 13:05:09.193657 5516 tablet_service.cc:1467] Processing CreateTablet for tablet 42dcf2e24d1c454a8b8a0ad179e78287 (DEFAULT_TABLE table=test-table [id=c467e5be6ff84998a9f5f909e191552d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:09.194155 5516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42dcf2e24d1c454a8b8a0ad179e78287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:09.195940 5651 tablet_service.cc:1467] Processing CreateTablet for tablet 42dcf2e24d1c454a8b8a0ad179e78287 (DEFAULT_TABLE table=test-table [id=c467e5be6ff84998a9f5f909e191552d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:09.196368 5651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42dcf2e24d1c454a8b8a0ad179e78287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:09.198058 5727 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Bootstrap starting.
I20260806 13:05:09.198808 5727 tablet_bootstrap.cc:654] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:09.199455 5727 log.cc:824] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:09.199859 5729 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: Bootstrap starting.
I20260806 13:05:09.200348 5727 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: No bootstrap required, opened a new log
I20260806 13:05:09.200436 5727 ts_tablet_manager.cc:1397] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:09.200739 5729 tablet_bootstrap.cc:654] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:09.201347 5729 log.cc:824] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:09.202292 5729 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: No bootstrap required, opened a new log
I20260806 13:05:09.202353 5729 ts_tablet_manager.cc:1397] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:05:09.202597 5727 raft_consensus.cc:348] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.202798 5727 raft_consensus.cc:374] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:09.202847 5727 raft_consensus.cc:729] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16de750822344feb9c125de4aaa7f494, State: Initialized, Role: FOLLOWER
I20260806 13:05:09.202996 5727 consensus_queue.cc:260] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.203375 5727 ts_tablet_manager.cc:1428] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260806 13:05:09.203410 5583 heartbeater.cc:503] Master 127.20.245.190:46585 was elected leader, sending a full tablet report...
I20260806 13:05:09.204541 5729 raft_consensus.cc:348] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.204754 5729 raft_consensus.cc:374] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:09.204810 5729 raft_consensus.cc:729] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2914185499de492c8be5e7f3f0cc06b4, State: Initialized, Role: FOLLOWER
I20260806 13:05:09.204947 5729 consensus_queue.cc:260] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.205295 5729 ts_tablet_manager.cc:1428] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:05:09.205325 5717 heartbeater.cc:503] Master 127.20.245.190:46585 was elected leader, sending a full tablet report...
I20260806 13:05:09.233750 5732 raft_consensus.cc:482] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:09.233985 5732 raft_consensus.cc:504] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.234536 5732 leader_election.cc:288] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055), 5f922b86e15140b88073be8859f17d41 (127.20.245.129:34603)
I20260806 13:05:09.238982 5451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.234949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:50309 (local address 127.20.245.129:34603)
0806 13:05:09.235018 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.235020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.235310 (+ 290us) server_negotiation.cc:407] Connection header received
0806 13:05:09.235404 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.235405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.235449 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.235514 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:09.235768 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.236606 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.238035 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.238541 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.238657 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.238808 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.238839 (+ 31us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.238893 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 13:05:09.238991 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.234890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:55325 (local address 127.20.245.130:34055)
0806 13:05:09.234961 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.234963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.234979 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:05:09.235068 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.235070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.235093 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.235163 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:09.235459 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.236367 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.238096 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.238542 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.238654 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.238668 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.238853 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.238902 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:05:09.238991 5719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.234813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:34055 (local address 127.20.245.131:55325)
0806 13:05:09.234916 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:09.234931 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:09.234997 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:09.235210 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:09.235211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:09.235213 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:09.235348 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.235351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.236478 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.236480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.237926 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.237929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.238652 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.238653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.238764 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.238767 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:05:09.238844 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 13:05:09.238894 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 13:05:09.238998 5733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.234849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34603 (local address 127.20.245.131:50309)
0806 13:05:09.235156 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:09.235205 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:09.235339 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:09.235545 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:09.235545 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:09.235547 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:09.235653 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.235655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.236701 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.236701 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.237931 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:09.237933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.238658 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.238659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:09.238746 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.238752 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:05:09.238800 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 13:05:09.238855 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":209,"threads_started":1}
I20260806 13:05:09.239521 5396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42dcf2e24d1c454a8b8a0ad179e78287" candidate_uuid: "2914185499de492c8be5e7f3f0cc06b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f922b86e15140b88073be8859f17d41" is_pre_election: true
I20260806 13:05:09.239544 5536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42dcf2e24d1c454a8b8a0ad179e78287" candidate_uuid: "2914185499de492c8be5e7f3f0cc06b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16de750822344feb9c125de4aaa7f494" is_pre_election: true
I20260806 13:05:09.239763 5396 raft_consensus.cc:2454] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2914185499de492c8be5e7f3f0cc06b4 in term 0.
I20260806 13:05:09.239782 5536 raft_consensus.cc:2454] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2914185499de492c8be5e7f3f0cc06b4 in term 0.
I20260806 13:05:09.240090 5604 leader_election.cc:302] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2914185499de492c8be5e7f3f0cc06b4, 5f922b86e15140b88073be8859f17d41; no voters:
I20260806 13:05:09.240307 5732 raft_consensus.cc:2781] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:05:09.240374 5732 raft_consensus.cc:482] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:05:09.240402 5732 raft_consensus.cc:3037] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:09.241343 5732 raft_consensus.cc:504] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.241508 5732 leader_election.cc:288] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [CANDIDATE]: Term 1 election: Requested vote from peers 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055), 5f922b86e15140b88073be8859f17d41 (127.20.245.129:34603)
I20260806 13:05:09.241714 5396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42dcf2e24d1c454a8b8a0ad179e78287" candidate_uuid: "2914185499de492c8be5e7f3f0cc06b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f922b86e15140b88073be8859f17d41"
I20260806 13:05:09.241751 5536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42dcf2e24d1c454a8b8a0ad179e78287" candidate_uuid: "2914185499de492c8be5e7f3f0cc06b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16de750822344feb9c125de4aaa7f494"
I20260806 13:05:09.241856 5396 raft_consensus.cc:3037] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:09.241854 5536 raft_consensus.cc:3037] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:09.242748 5536 raft_consensus.cc:2454] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2914185499de492c8be5e7f3f0cc06b4 in term 1.
W20260806 13:05:09.242945 5585 tablet.cc:2369] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:09.243046 5396 raft_consensus.cc:2454] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2914185499de492c8be5e7f3f0cc06b4 in term 1.
I20260806 13:05:09.243260 5604 leader_election.cc:302] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2914185499de492c8be5e7f3f0cc06b4, 5f922b86e15140b88073be8859f17d41; no voters:
I20260806 13:05:09.243373 5732 raft_consensus.cc:2781] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:09.243610 5732 raft_consensus.cc:686] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 LEADER]: Becoming Leader. State: Replica: 2914185499de492c8be5e7f3f0cc06b4, State: Running, Role: LEADER
I20260806 13:05:09.243754 5732 consensus_queue.cc:237] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:09.244912 5251 catalog_manager.cc:5495] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131). New cstate: current_term: 1 leader_uuid: "2914185499de492c8be5e7f3f0cc06b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260806 13:05:09.254504 5724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.251434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35690 (local address 127.20.245.131:34803)
0806 13:05:09.251513 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:09.251515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:09.251525 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:05:09.251628 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:09.251629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:09.251651 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:09.251737 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:05:09.251888 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.252407 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.253277 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:09.253490 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:09.253554 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:09.253844 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:05:09.253991 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:05:09.254082 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:09.254260 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 13:05:09.254290 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 13:05:09.257436 5536 raft_consensus.cc:1261] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 1 FOLLOWER]: Refusing update from remote peer 2914185499de492c8be5e7f3f0cc06b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:09.257491 5396 raft_consensus.cc:1261] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Refusing update from remote peer 2914185499de492c8be5e7f3f0cc06b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:09.257953 5734 consensus_queue.cc:1035] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:09.258138 5732 consensus_queue.cc:1035] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:09.261186 5738 mvcc.cc:205] Tried to move back new op lower bound from 7315544101914820608 to 7315544101863313408. Current Snapshot: MvccSnapshot[applied={T|T < 7315544101914820608}]
I20260806 13:05:09.265024 5250 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35942:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:09.265210 5250 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35942:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:09.266323 5250 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Sending DeleteTablet for 3 replicas of tablet 42dcf2e24d1c454a8b8a0ad179e78287
I20260806 13:05:09.266754 5651 tablet_service.cc:1514] Processing DeleteTablet for tablet 42dcf2e24d1c454a8b8a0ad179e78287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:09 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:35688
I20260806 13:05:09.266847 5516 tablet_service.cc:1514] Processing DeleteTablet for tablet 42dcf2e24d1c454a8b8a0ad179e78287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:09 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:51974
I20260806 13:05:09.266928 5376 tablet_service.cc:1514] Processing DeleteTablet for tablet 42dcf2e24d1c454a8b8a0ad179e78287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:09 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:60882
I20260806 13:05:09.267071 5452 tablet_replica.cc:330] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: stopping tablet replica
I20260806 13:05:09.267130 5452 raft_consensus.cc:2229] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:09.267127 5748 tablet_replica.cc:330] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: stopping tablet replica
I20260806 13:05:09.267222 5452 raft_consensus.cc:2258] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:09.267285 5748 raft_consensus.cc:2229] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:05:09.267452 5748 raft_consensus.cc:2258] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:09.267647 5749 tablet_replica.cc:330] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: stopping tablet replica
I20260806 13:05:09.267727 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 5290
I20260806 13:05:09.267786 5749 raft_consensus.cc:2229] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:09.268061 5748 ts_tablet_manager.cc:1905] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:09.269025 5749 raft_consensus.cc:2258] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:09.269647 5749 ts_tablet_manager.cc:1905] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:09.270520 5748 ts_tablet_manager.cc:1918] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:09.270673 5748 log.cc:1196] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/42dcf2e24d1c454a8b8a0ad179e78287
I20260806 13:05:09.271198 5748 ts_tablet_manager.cc:1939] T 42dcf2e24d1c454a8b8a0ad179e78287 P 2914185499de492c8be5e7f3f0cc06b4: Deleting consensus metadata
I20260806 13:05:09.271534 5749 ts_tablet_manager.cc:1918] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:09.271634 5749 log.cc:1196] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/42dcf2e24d1c454a8b8a0ad179e78287
I20260806 13:05:09.271925 5749 ts_tablet_manager.cc:1939] T 42dcf2e24d1c454a8b8a0ad179e78287 P 16de750822344feb9c125de4aaa7f494: Deleting consensus metadata
I20260806 13:05:09.271930 5238 catalog_manager.cc:4841] TS 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803): tablet 42dcf2e24d1c454a8b8a0ad179e78287 (table test-table [id=c467e5be6ff84998a9f5f909e191552d]) successfully deleted
I20260806 13:05:09.272450 5238 catalog_manager.cc:4841] TS 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055): tablet 42dcf2e24d1c454a8b8a0ad179e78287 (table test-table [id=c467e5be6ff84998a9f5f909e191552d]) successfully deleted
W20260806 13:05:09.278334 5236 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:34603 (error 108)
I20260806 13:05:09.279218 5450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:09.279011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34603 (local address 127.0.0.1:60886)
0806 13:05:09.279079 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:09.279141 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:34603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 13:05:09.279227 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 5448
W20260806 13:05:09.279373 5236 catalog_manager.cc:4584] TS 5f922b86e15140b88073be8859f17d41 (127.20.245.129:34603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 42dcf2e24d1c454a8b8a0ad179e78287: Network error: Client connection negotiation failed: client connection to 127.20.245.129:34603: connect: Connection refused (error 111)
I20260806 13:05:09.287086 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 5587
I20260806 13:05:09.293598 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 5218
I20260806 13:05:29.301787 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46585
--webserver_interface=127.20.245.190
--webserver_port=39025
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:46585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:29.409629 5751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:29.409957 5751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:29.410001 5751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:29.411545 5751 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 13:05:29.411625 5751 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 13:05:29.411649 5751 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 13:05:29.411674 5751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:29.411711 5751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:29.411761 5751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:29.411795 5751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:29.411828 5751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:29.413605 5751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:46585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:46585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=39025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:29.413978 5751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:29.414288 5751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:29.421481 5757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:29.421728 5751 server_base.cc:1034] running on GCE node
W20260806 13:05:29.421489 5756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:29.421643 5759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:29.422240 5751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:29.422593 5751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:29.423796 5751 hybrid_clock.cc:648] HybridClock initialized: now 1786021529423761 us; error 46 us; skew 500 ppm
Aug 06 13:05:29 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021529, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:29.427843 5751 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:05:29.428514 5751 webserver.cc:460] Webserver started at http://127.20.245.190:39025/ using document root <none> and password file <none>
I20260806 13:05:29.428867 5751 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:29.428932 5751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:29.430778 5751 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:29.431936 5766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:29.432184 5751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:05:29.432309 5751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "d1d6070122ad46998a070d44aa4b8c90"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b47b6fdeec4f97c167a1f02a5742545"
server_key_iv: "a2d614e7c178c22c5a41853e28da99fe"
server_key_version: "encryptionkey@0"
I20260806 13:05:29.432879 5751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:29.449913 5751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:29.452661 5751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:29.452816 5751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:29.458639 5751 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:46585
I20260806 13:05:29.458743 5819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:46585 every 8 connection(s)
I20260806 13:05:29.459337 5751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:29.461522 5820 sys_catalog.cc:263] Verifying existing consensus state
I20260806 13:05:29.462265 5820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Bootstrap starting.
I20260806 13:05:29.469653 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 5751
I20260806 13:05:29.470121 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:34603
--local_ip_for_outbound_sockets=127.20.245.129
--tserver_master_addrs=127.20.245.190:46585
--webserver_port=43159
--webserver_interface=127.20.245.129
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:05:29.472327 5820 log.cc:824] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:29.474992 5820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:05:29.475392 5820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Bootstrap complete.
I20260806 13:05:29.477870 5820 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:05:29.478137 5820 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d6070122ad46998a070d44aa4b8c90, State: Initialized, Role: FOLLOWER
I20260806 13:05:29.478348 5820 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:05:29.478452 5820 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:29.478513 5820 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:29.478561 5820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 2 FOLLOWER]: Advancing to term 3
I20260806 13:05:29.479715 5820 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:05:29.479839 5820 leader_election.cc:302] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1d6070122ad46998a070d44aa4b8c90; no voters:
I20260806 13:05:29.480058 5820 leader_election.cc:288] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 13:05:29.480104 5824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 13:05:29.480242 5824 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [term 3 LEADER]: Becoming Leader. State: Replica: d1d6070122ad46998a070d44aa4b8c90, State: Running, Role: LEADER
I20260806 13:05:29.480360 5820 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:29.480392 5824 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } }
I20260806 13:05:29.480861 5824 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1d6070122ad46998a070d44aa4b8c90. Latest consensus state: current_term: 3 leader_uuid: "d1d6070122ad46998a070d44aa4b8c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } } }
I20260806 13:05:29.481076 5824 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:29.480847 5826 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d1d6070122ad46998a070d44aa4b8c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1d6070122ad46998a070d44aa4b8c90" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 46585 } } }
I20260806 13:05:29.481415 5826 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:29.481559 5833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:29.482684 5833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:29.482833 5833 catalog_manager.cc:1259] Loaded cluster ID: 2a32ffa137344f2790ffae4a8d34ed93
I20260806 13:05:29.482880 5833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:05:29.483800 5833 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:29.484004 5833 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Loaded TSK: 0
I20260806 13:05:29.484058 5833 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d1d6070122ad46998a070d44aa4b8c90: Loaded TSK: 1
F20260806 13:05:29.484319 5833 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f91abbc99ad google::LogMessage::Fail() at ??:0
@ 0x7f91abbcc88a google::LogMessage::SendToLog() at ??:0
@ 0x7f91abbc94de google::LogMessage::Flush() at ??:0
@ 0x7f91abbcaa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f91ae336104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f91ae333d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f91b3b271cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f91b3b2748e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f91b3b27594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f91b3aedc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f91b3af7ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f91ada970d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f91ada8c954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f91ae8f06db start_thread at ??:0
@ 0x7f91aa6c761f clone at ??:0
W20260806 13:05:29.596069 5822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:29.596470 5822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:29.596570 5822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:29.598371 5822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:29.598445 5822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:29.598496 5822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:05:29.600426 5822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:34603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=43159
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:29.600734 5822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:29.600998 5822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:29.606830 5866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:29.607128 5822 server_base.cc:1034] running on GCE node
W20260806 13:05:29.606964 5864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:29.606820 5863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:29.607679 5822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:29.608170 5822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:29.609385 5822 hybrid_clock.cc:648] HybridClock initialized: now 1786021529609326 us; error 81 us; skew 500 ppm
Aug 06 13:05:29 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021529, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:29.613178 5822 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:05:29.614218 5822 webserver.cc:460] Webserver started at http://127.20.245.129:43159/ using document root <none> and password file <none>
I20260806 13:05:29.614566 5822 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:29.614653 5822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:29.616901 5822 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:29.618376 5874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:29.618711 5822 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:29.618887 5822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "5f922b86e15140b88073be8859f17d41"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "a6637fa3d089e01ca0bc9498f976b6e6"
server_key_iv: "c7d158065091e11bcfebb4a7f3d0e391"
server_key_version: "encryptionkey@0"
I20260806 13:05:29.619408 5822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:29.656781 5822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:29.659795 5822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:29.659969 5822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:29.660240 5822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:29.660801 5881 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 13:05:29.664178 5822 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 13:05:29.664276 5822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260806 13:05:29.664326 5822 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 13:05:29.665261 5822 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 13:05:29.665323 5822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 13:05:29.665439 5881 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Bootstrap starting.
I20260806 13:05:29.675093 5822 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:34603
I20260806 13:05:29.675298 5989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:34603 every 8 connection(s)
I20260806 13:05:29.675625 5822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:05:29.678582 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 5822
I20260806 13:05:29.678982 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:34055
--local_ip_for_outbound_sockets=127.20.245.130
--tserver_master_addrs=127.20.245.190:46585
--webserver_port=39247
--webserver_interface=127.20.245.130
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:05:29.682390 5881 log.cc:824] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:29.686820 5881 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 13:05:29.687342 5881 tablet_bootstrap.cc:492] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Bootstrap complete.
I20260806 13:05:29.688800 5881 ts_tablet_manager.cc:1397] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.012s
I20260806 13:05:29.690548 5881 raft_consensus.cc:348] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:29.690934 5881 raft_consensus.cc:729] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f922b86e15140b88073be8859f17d41, State: Initialized, Role: FOLLOWER
I20260806 13:05:29.691205 5881 consensus_queue.cc:260] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:29.691817 5881 ts_tablet_manager.cc:1428] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
W20260806 13:05:29.767227 5992 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:05:29.676632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:50001)
0806 13:05:29.676953 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:29.677008 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:29.677572 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:29.766745 (+ 89173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":177,"threads_started":1}
W20260806 13:05:29.767644 5990 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:46585 (0 consecutive failures): Network error: Failed to ping master at 127.20.245.190:46585: Client connection negotiation failed: client connection to 127.20.245.190:46585: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 13:05:29.768244 5992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:29.768015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:48727)
0806 13:05:29.768127 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:29.768211 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 13:05:29.768728 5992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:29.768620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:39409)
0806 13:05:29.768673 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:29.768703 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 13:05:29.768857 5990 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 13:05:29.782344 5993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:29.782617 5993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:29.782661 5993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:29.784497 5993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:29.784586 5993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:29.784641 5993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:05:29.786576 5993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:34055
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=39247
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:29.786899 5993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:29.787163 5993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:29.794129 6001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:29.794108 5993 server_base.cc:1034] running on GCE node
W20260806 13:05:29.794081 6003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:29.794150 6000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:29.794668 5993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:29.795025 5993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:29.796201 5993 hybrid_clock.cc:648] HybridClock initialized: now 1786021529796183 us; error 59 us; skew 500 ppm
Aug 06 13:05:29 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021529, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:29.799953 5993 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:05:29.800529 5993 webserver.cc:460] Webserver started at http://127.20.245.130:39247/ using document root <none> and password file <none>
I20260806 13:05:29.800783 5993 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:29.800853 5993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:29.802541 5993 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:29.803474 6011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:29.803716 5993 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:29.803903 5993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "16de750822344feb9c125de4aaa7f494"
format_stamp: "Formatted at 2026-08-06 13:04:47 on dist-test-slave-srgv"
server_key: "1b6ceb764b21231b5a9e703279a832fb"
server_key_iv: "cfd0d24fa1c860d910ae3d6657d24f71"
server_key_version: "encryptionkey@0"
I20260806 13:05:29.804297 5993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:29.834285 5993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:29.837754 5993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:29.837966 5993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:29.838369 5993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:29.838902 5993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:29.838995 5993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:29.839080 5993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:29.839135 5993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:29.850154 5993 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:34055
I20260806 13:05:29.850298 6126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:34055 every 8 connection(s)
I20260806 13:05:29.850780 5993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:05:29.852344 6129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:29.851755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:58919)
0806 13:05:29.852043 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:29.852167 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":119,"threads_started":1}
W20260806 13:05:29.852906 6127 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:46585 (0 consecutive failures): Network error: Failed to ping master at 127.20.245.190:46585: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
I20260806 13:05:29.853473 6129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:29.853299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:49813)
0806 13:05:29.853394 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:29.853436 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 13:05:29.854048 6129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:29.853932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:46941)
0806 13:05:29.853989 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:29.854023 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260806 13:05:29.854274 6127 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 13:05:29.856503 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 5993
I20260806 13:05:29.857136 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:34803
--local_ip_for_outbound_sockets=127.20.245.131
--tserver_master_addrs=127.20.245.190:46585
--webserver_port=40111
--webserver_interface=127.20.245.131
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:29.959672 6130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:29.959930 6130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:29.959959 6130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:29.961244 6130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:29.961292 6130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:29.961320 6130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:05:29.962889 6130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:34803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=40111
--tserver_master_addrs=127.20.245.190:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:29.963238 6130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:29.963538 6130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:29.969640 6135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:29.969653 6136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:29.969663 6138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:29.970131 6130 server_base.cc:1034] running on GCE node
I20260806 13:05:29.970440 6130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:29.970794 6130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:29.971966 6130 hybrid_clock.cc:648] HybridClock initialized: now 1786021529971921 us; error 65 us; skew 500 ppm
Aug 06 13:05:29 dist-test-slave-srgv krb5kdc[4657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021529, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:29.975525 6130 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:05:29.976183 6130 webserver.cc:460] Webserver started at http://127.20.245.131:40111/ using document root <none> and password file <none>
I20260806 13:05:29.976490 6130 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:29.976564 6130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:29.978289 6130 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 13:05:29.979378 6145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:29.979699 6130 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:29.979827 6130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "2914185499de492c8be5e7f3f0cc06b4"
format_stamp: "Formatted at 2026-08-06 13:04:48 on dist-test-slave-srgv"
server_key: "6ffbd24c1b082044970b497c0c6064d0"
server_key_iv: "6874453208f729993860453dc1cedf9a"
server_key_version: "encryptionkey@0"
I20260806 13:05:29.980379 6130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:29.998982 6130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:30.001806 6130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:30.002019 6130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:30.002346 6130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:30.002754 6130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:30.002815 6130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:30.002861 6130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:30.002894 6130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:30.011970 6130 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:34803
I20260806 13:05:30.012076 6259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:34803 every 8 connection(s)
I20260806 13:05:30.012604 6130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:05:30.014091 6262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:30.013590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:53749)
0806 13:05:30.013798 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:30.013897 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":94,"threads_started":1}
W20260806 13:05:30.014616 6260 heartbeater.cc:644] Failed to heartbeat to 127.20.245.190:46585 (0 consecutive failures): Network error: Failed to ping master at 127.20.245.190:46585: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
I20260806 13:05:30.015031 6262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:30.014920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:42009)
0806 13:05:30.014979 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:30.015013 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 13:05:30.015479 6262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:30.015369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:49903)
0806 13:05:30.015416 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:30.015442 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 13:05:30.015627 6260 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 13:05:30.016368 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 6130
I20260806 13:05:30.769690 6264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:30.769333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:54357)
0806 13:05:30.769558 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:30.769620 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":91,"threads_started":1}
I20260806 13:05:30.855105 6265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:30.854785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:38441)
0806 13:05:30.854970 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:30.855023 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":103,"threads_started":1}
I20260806 13:05:31.016466 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:31.016144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:50473)
0806 13:05:31.016294 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:31.016369 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260806 13:05:31.416718 6267 raft_consensus.cc:482] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:31.416953 6267 raft_consensus.cc:504] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:31.417418 6267 leader_election.cc:288] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803), 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055)
Aug 06 13:05:31 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021529, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.131@KRBTEST.COM
Aug 06 13:05:31 dist-test-slave-srgv krb5kdc[4657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021529, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.130@KRBTEST.COM
I20260806 13:05:31.430552 6269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:31.417765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:52895 (local address 127.20.245.131:34803)
0806 13:05:31.417979 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:31.417994 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:31.418047 (+ 53us) server_negotiation.cc:407] Connection header received
0806 13:05:31.418667 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:31.418671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:31.418729 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:31.418900 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:31.420029 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:31.421101 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:31.422348 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:31.422883 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:31.423025 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:31.425864 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:31.425869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:31.425870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:31.425883 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:31.428395 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:31.429049 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:31.429060 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:31.429061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:31.429198 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:31.429477 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:31.429478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:31.429479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:31.429824 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:31.429927 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:31.430225 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 13:05:31.430398 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":70,"threads_started":1}
I20260806 13:05:31.430559 6271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:31.418083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:42849 (local address 127.20.245.130:34055)
0806 13:05:31.418267 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:31.418280 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:31.418306 (+ 26us) server_negotiation.cc:407] Connection header received
0806 13:05:31.418863 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:31.418867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:31.418932 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:31.419099 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:31.420100 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:31.421083 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:31.422444 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:31.422986 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:31.423124 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:31.426109 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:31.426115 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:31.426115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:31.426127 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:31.428432 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:31.429038 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:31.429042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:31.429042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:31.429145 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:31.429440 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:31.429442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:31.429442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:31.429730 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:31.429803 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:31.430231 (+ 428us) server_negotiation.cc:299] Negotiation successful
0806 13:05:31.430385 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260806 13:05:31.430533 6270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:31.417906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:34055 (local address 127.20.245.129:42849)
0806 13:05:31.417997 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:31.418006 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:31.418047 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:31.419122 (+ 1075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:31.419124 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:31.419639 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:31.419888 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:31.419967 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:31.421207 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:31.421209 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:31.422288 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:31.422292 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:31.423079 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:31.423080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:31.423145 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:31.423886 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:31.423896 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:31.425980 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:31.428544 (+ 2564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:31.428545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:31.428545 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:31.428928 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:31.429223 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:31.429224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:31.429224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:31.429364 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:31.429831 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:31.429840 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:31.430024 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 13:05:31.430157 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 13:05:31.430417 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":175,"thread_start_us":58,"threads_started":1}
I20260806 13:05:31.430701 6268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:31.417669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:34803 (local address 127.20.245.129:52895)
0806 13:05:31.417815 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:31.417827 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:31.417902 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:31.418979 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:31.418983 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:31.419632 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:31.419888 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:31.419895 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:31.421301 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:31.421302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:31.422251 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:31.422254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:31.422992 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:31.422993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:31.423134 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:31.423924 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:31.423929 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:31.425681 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:31.428496 (+ 2815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:31.428507 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:31.428510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:31.428924 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:31.429293 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:31.429293 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:31.429294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:31.429378 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:31.429921 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:31.429923 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:31.430025 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 13:05:31.430160 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 13:05:31.430517 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":197,"thread_start_us":98,"threads_started":1}
W20260806 13:05:31.431753 5878 leader_election.cc:341] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055): Not found: Tablet not found: 42dcf2e24d1c454a8b8a0ad179e78287
W20260806 13:05:31.432320 5878 leader_election.cc:341] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803): Not found: Tablet not found: 42dcf2e24d1c454a8b8a0ad179e78287
I20260806 13:05:31.432402 5878 leader_election.cc:302] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f922b86e15140b88073be8859f17d41; no voters: 16de750822344feb9c125de4aaa7f494, 2914185499de492c8be5e7f3f0cc06b4
I20260806 13:05:31.432543 6267 raft_consensus.cc:2726] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:05:31.770562 6270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:31.770296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:43601)
0806 13:05:31.770418 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:31.770498 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260806 13:05:31.856092 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:31.855688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:55041)
0806 13:05:31.855911 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:31.856013 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":73,"threads_started":1}
I20260806 13:05:32.017477 6273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:32.017098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:33145)
0806 13:05:32.017363 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:32.017428 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":154,"threads_started":1}
I20260806 13:05:32.771732 6274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:32.771406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:52419)
0806 13:05:32.771608 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:32.771668 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":97,"threads_started":1}
I20260806 13:05:32.857214 6275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:32.856871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:41939)
0806 13:05:32.857084 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:32.857143 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":97,"threads_started":1}
I20260806 13:05:33.018750 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:33.018337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:58019)
0806 13:05:33.018628 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:33.018679 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":183,"threads_started":1}
I20260806 13:05:33.228621 6277 raft_consensus.cc:482] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:33.228760 6277 raft_consensus.cc:504] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:33.229066 6277 leader_election.cc:288] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803), 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055)
W20260806 13:05:33.229768 5878 leader_election.cc:341] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803): Not found: Tablet not found: 42dcf2e24d1c454a8b8a0ad179e78287
W20260806 13:05:33.229873 5878 leader_election.cc:341] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055): Not found: Tablet not found: 42dcf2e24d1c454a8b8a0ad179e78287
I20260806 13:05:33.229928 5878 leader_election.cc:302] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f922b86e15140b88073be8859f17d41; no voters: 16de750822344feb9c125de4aaa7f494, 2914185499de492c8be5e7f3f0cc06b4
I20260806 13:05:33.230001 6277 raft_consensus.cc:2726] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:05:33.772785 6278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:33.772398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:41749)
0806 13:05:33.772645 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:33.772716 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":115,"threads_started":1}
I20260806 13:05:33.858316 6280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:33.858013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:57287)
0806 13:05:33.858190 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:33.858249 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
I20260806 13:05:34.019829 6281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:34.019498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:50553)
0806 13:05:34.019701 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:34.019762 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
I20260806 13:05:34.773784 6282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:34.773471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:51807)
0806 13:05:34.773668 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:34.773719 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":89,"threads_started":1}
I20260806 13:05:34.859125 6283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:34.858847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:33633)
0806 13:05:34.859016 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:34.859061 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":83,"threads_started":1}
I20260806 13:05:35.020824 6284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:35.020448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:42371)
0806 13:05:35.020627 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:35.020673 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":87,"threads_started":1}
I20260806 13:05:35.214898 6285 raft_consensus.cc:482] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:35.215054 6285 raft_consensus.cc:504] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:35.215330 6285 leader_election.cc:288] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803), 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055)
W20260806 13:05:35.216071 5878 leader_election.cc:341] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803): Not found: Tablet not found: 42dcf2e24d1c454a8b8a0ad179e78287
W20260806 13:05:35.216174 5878 leader_election.cc:341] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055): Not found: Tablet not found: 42dcf2e24d1c454a8b8a0ad179e78287
I20260806 13:05:35.216284 5878 leader_election.cc:302] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f922b86e15140b88073be8859f17d41; no voters: 16de750822344feb9c125de4aaa7f494, 2914185499de492c8be5e7f3f0cc06b4
I20260806 13:05:35.216418 6285 raft_consensus.cc:2726] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:05:35.774837 6286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:35.774514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:35903)
0806 13:05:35.774698 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:35.774762 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":76,"threads_started":1}
I20260806 13:05:35.860200 6287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:35.859862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:42367)
0806 13:05:35.860079 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:35.860142 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":99,"threads_started":1}
I20260806 13:05:36.021881 6288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:36.021476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:42039)
0806 13:05:36.021749 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:36.021824 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":167,"threads_started":1}
I20260806 13:05:36.775907 6289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:36.775582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:38941)
0806 13:05:36.775779 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:36.775838 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":103,"threads_started":1}
I20260806 13:05:36.861416 6290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:36.860951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:42001)
0806 13:05:36.861237 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:36.861328 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":136,"threads_started":1}
I20260806 13:05:37.023046 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:37.022621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:50203)
0806 13:05:37.022916 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:37.022972 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":120,"threads_started":1}
I20260806 13:05:37.776995 6292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:37.776685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:49135)
0806 13:05:37.776877 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:37.776930 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":85,"threads_started":1}
I20260806 13:05:37.862421 6293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:37.862092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:34011)
0806 13:05:37.862291 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:37.862355 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":89,"threads_started":1}
I20260806 13:05:38.024160 6294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:38.023729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:57279)
0806 13:05:38.024036 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:38.024092 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":91,"threads_started":1}
I20260806 13:05:38.777968 6295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:38.777622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:39991)
0806 13:05:38.777840 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:38.777899 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":79,"threads_started":1}
I20260806 13:05:38.863350 6296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:38.862943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:60503)
0806 13:05:38.863218 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:38.863291 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":119,"threads_started":1}
I20260806 13:05:39.025043 6298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:39.024699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:49555)
0806 13:05:39.024878 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:39.024986 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":93,"threads_started":1}
I20260806 13:05:39.757788 6299 raft_consensus.cc:482] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:39.757946 6299 raft_consensus.cc:504] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914185499de492c8be5e7f3f0cc06b4" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34803 } } peers { permanent_uuid: "16de750822344feb9c125de4aaa7f494" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 34055 } } peers { permanent_uuid: "5f922b86e15140b88073be8859f17d41" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34603 } }
I20260806 13:05:39.758152 6299 leader_election.cc:288] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803), 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055)
W20260806 13:05:39.758759 5878 leader_election.cc:341] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2914185499de492c8be5e7f3f0cc06b4 (127.20.245.131:34803): Not found: Tablet not found: 42dcf2e24d1c454a8b8a0ad179e78287
W20260806 13:05:39.758883 5878 leader_election.cc:341] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16de750822344feb9c125de4aaa7f494 (127.20.245.130:34055): Not found: Tablet not found: 42dcf2e24d1c454a8b8a0ad179e78287
I20260806 13:05:39.758904 5878 leader_election.cc:302] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f922b86e15140b88073be8859f17d41; no voters: 16de750822344feb9c125de4aaa7f494, 2914185499de492c8be5e7f3f0cc06b4
I20260806 13:05:39.759001 6299 raft_consensus.cc:2726] T 42dcf2e24d1c454a8b8a0ad179e78287 P 5f922b86e15140b88073be8859f17d41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 13:05:39.779067 6300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:39.778744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:47969)
0806 13:05:39.778955 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:39.779015 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":88,"threads_started":1}
I20260806 13:05:39.864390 6301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:39.864044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:43207)
0806 13:05:39.864280 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:39.864340 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":139,"threads_started":1}
I20260806 13:05:40.026075 6302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:40.025744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:32857)
0806 13:05:40.025962 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:40.026024 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":122,"threads_started":1}
I20260806 13:05:40.780154 6303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:40.779772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:56673)
0806 13:05:40.779986 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:40.780040 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":87,"threads_started":1}
I20260806 13:05:40.865484 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:40.865122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:45273)
0806 13:05:40.865350 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:40.865412 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":113,"threads_started":1}
I20260806 13:05:41.027060 6305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:41.026744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:52799)
0806 13:05:41.026935 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:41.026992 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":91,"threads_started":1}
I20260806 13:05:41.781136 6306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:41.780803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:52155)
0806 13:05:41.781009 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:41.781060 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":95,"threads_started":1}
I20260806 13:05:41.866499 6307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:41.866197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:45517)
0806 13:05:41.866370 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:41.866431 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":79,"threads_started":1}
I20260806 13:05:42.028223 6308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:42.027815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:33461)
0806 13:05:42.028048 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:42.028119 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":97,"threads_started":1}
I20260806 13:05:42.782635 6309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:42.782108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:37047)
0806 13:05:42.782392 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:42.782500 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":138,"threads_started":1}
I20260806 13:05:42.867709 6310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:42.867360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:55603)
0806 13:05:42.867585 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:42.867651 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":115,"threads_started":1}
I20260806 13:05:43.029194 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:43.028827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:37287)
0806 13:05:43.029042 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:43.029118 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":76,"threads_started":1}
I20260806 13:05:43.783957 6312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:43.783636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:58683)
0806 13:05:43.783838 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:43.783891 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":110,"threads_started":1}
I20260806 13:05:43.868695 6313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:43.868401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:33719)
0806 13:05:43.868570 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:43.868624 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":93,"threads_started":1}
I20260806 13:05:44.030232 6314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:44.029940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:49163)
0806 13:05:44.030114 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:44.030166 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":99,"threads_started":1}
I20260806 13:05:44.785059 6315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:44.784712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.129:49443)
0806 13:05:44.784939 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:44.785001 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
I20260806 13:05:44.869849 6316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:44.869551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.130:40981)
0806 13:05:44.869735 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:44.869784 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":71,"threads_started":1}
I20260806 13:05:45.020619 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 5822
I20260806 13:05:45.027714 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 5993
I20260806 13:05:45.031281 6317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:45.030885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:46585 (local address 127.20.245.131:42101)
0806 13:05:45.031084 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:45.031162 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.190:46585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":62,"threads_started":1}
I20260806 13:05:45.034585 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 6130
2026-08-06T13:05:45Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58937 ms)
[----------] 30 tests from SecurityITest (269953 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:05:45 dist-test-slave-srgv krb5kdc[6320](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:05:45 dist-test-slave-srgv krb5kdc[6320](info): set up 2 sockets
Aug 06 13:05:45 dist-test-slave-srgv krb5kdc[6320](info): commencing operation
krb5kdc: starting...
W20260806 13:05:46.172091 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:05:46 dist-test-slave-srgv krb5kdc[6320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:05:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:05:46.323505 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:45851
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:45851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:46.425534 6333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:46.425854 6333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:46.425899 6333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:46.427332 6333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:46.427407 6333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:46.427430 6333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:46.427465 6333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:46.427493 6333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:46.429270 6333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:45851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:45851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:46.429663 6333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:46.429965 6333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:46.436072 6339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:46.436072 6341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:46.436072 6338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:46.436514 6333 server_base.cc:1034] running on GCE node
I20260806 13:05:46.436909 6333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:46.437259 6333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:46.438431 6333 hybrid_clock.cc:648] HybridClock initialized: now 1786021546438373 us; error 75 us; skew 500 ppm
Aug 06 13:05:46 dist-test-slave-srgv krb5kdc[6320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021546, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:46.442368 6333 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:05:46.443076 6333 webserver.cc:460] Webserver started at http://127.20.245.190:46729/ using document root <none> and password file <none>
I20260806 13:05:46.443447 6333 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:46.443508 6333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:46.443640 6333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:46.444981 6333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "3eb754b460c142f1aaac295468d7da51"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "a1195897451ac23f966504931e081b14"
server_key_iv: "2f05dd4275bf853b33e8876311bbfca3"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.445365 6333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "3eb754b460c142f1aaac295468d7da51"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "a1195897451ac23f966504931e081b14"
server_key_iv: "2f05dd4275bf853b33e8876311bbfca3"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.447156 6333 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:05:46.448563 6348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:46.448882 6333 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:05:46.449051 6333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "3eb754b460c142f1aaac295468d7da51"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "a1195897451ac23f966504931e081b14"
server_key_iv: "2f05dd4275bf853b33e8876311bbfca3"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.449203 6333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:46.473748 6333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:46.476653 6333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:46.476914 6333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:46.482766 6333 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:45851
I20260806 13:05:46.482858 6401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:45851 every 8 connection(s)
I20260806 13:05:46.483431 6333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:46.484553 6402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:46.487566 6402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51: Bootstrap starting.
I20260806 13:05:46.488283 6402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:46.488569 6402 log.cc:824] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:46.489480 6402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51: No bootstrap required, opened a new log
I20260806 13:05:46.491405 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 6333
I20260806 13:05:46.491544 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:46.491803 21462 external_mini_cluster.cc:1428] Setting key 8b3372bd6f30e815bc4f2eb93422313e
I20260806 13:05:46.491847 6402 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb754b460c142f1aaac295468d7da51" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45851 } }
I20260806 13:05:46.492089 6402 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:46.492147 6402 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb754b460c142f1aaac295468d7da51, State: Initialized, Role: FOLLOWER
I20260806 13:05:46.492343 6402 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb754b460c142f1aaac295468d7da51" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45851 } }
I20260806 13:05:46.492431 6402 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:46.492479 6402 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:46.492534 6402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:46.493870 6402 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb754b460c142f1aaac295468d7da51" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45851 } }
I20260806 13:05:46.494030 6402 leader_election.cc:302] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3eb754b460c142f1aaac295468d7da51; no voters:
I20260806 13:05:46.494288 6402 leader_election.cc:288] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:46.494469 6407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:46.494742 6402 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:46.494741 6407 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [term 1 LEADER]: Becoming Leader. State: Replica: 3eb754b460c142f1aaac295468d7da51, State: Running, Role: LEADER
I20260806 13:05:46.495031 6407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb754b460c142f1aaac295468d7da51" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45851 } }
I20260806 13:05:46.495878 6408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3eb754b460c142f1aaac295468d7da51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb754b460c142f1aaac295468d7da51" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45851 } } }
I20260806 13:05:46.495987 6408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:46.496373 6409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eb754b460c142f1aaac295468d7da51. Latest consensus state: current_term: 1 leader_uuid: "3eb754b460c142f1aaac295468d7da51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb754b460c142f1aaac295468d7da51" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45851 } } }
I20260806 13:05:46.496424 6417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:46.496459 6409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:46.497179 6417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:46.499542 6417 catalog_manager.cc:1347] Generated new cluster ID: 1cfff80d9fa54c2ba19c3d2dbcccb9c8
I20260806 13:05:46.499612 6417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:05:46 dist-test-slave-srgv krb5kdc[6320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:46.506989 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:46.492743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37928 (local address 127.20.245.190:45851)
0806 13:05:46.492974 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:46.492993 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:46.493027 (+ 34us) server_negotiation.cc:407] Connection header received
0806 13:05:46.493170 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:46.493177 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:46.493247 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:46.493389 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:46.494518 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.496244 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.497520 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.498166 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.498327 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:46.501750 (+ 3423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:46.501756 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:46.501756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:46.501773 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:46.504787 (+ 3014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:46.505351 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:46.505355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:46.505355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:46.505509 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:46.505750 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:46.505750 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:46.505751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:46.506162 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:46.506370 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:46.506521 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 13:05:46.506693 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":126,"threads_started":1}
I20260806 13:05:46.508059 6417 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:46.508880 6417 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:46.519038 6417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51: Generated new TSK 0
I20260806 13:05:46.519420 6417 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:05:46.559255 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:45851
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:46.663120 6428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:46.663483 6428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:46.663518 6428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:46.665135 6428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:46.665220 6428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:46.665254 6428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:05:46.667253 6428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:45851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:46.667614 6428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:46.667965 6428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:46.674427 6433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:46.674410 6436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:46.674607 6428 server_base.cc:1034] running on GCE node
W20260806 13:05:46.674410 6434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:46.674970 6428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:46.675388 6428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:46.676623 6428 hybrid_clock.cc:648] HybridClock initialized: now 1786021546676601 us; error 34 us; skew 500 ppm
Aug 06 13:05:46 dist-test-slave-srgv krb5kdc[6320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021546, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:46.680199 6428 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:05:46.680786 6428 webserver.cc:460] Webserver started at http://127.20.245.129:37647/ using document root <none> and password file <none>
I20260806 13:05:46.681056 6428 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:46.681109 6428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:46.681236 6428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:46.682569 6428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "2a277b56ac9e4b6bb3966ec47039721a"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "7187453732c1e2c131fbae81a6a02d39"
server_key_iv: "00dc7cccb049d3dc78ef4bd532d32b7b"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.682976 6428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "2a277b56ac9e4b6bb3966ec47039721a"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "7187453732c1e2c131fbae81a6a02d39"
server_key_iv: "00dc7cccb049d3dc78ef4bd532d32b7b"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.684823 6428 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 13:05:46.685806 6444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:46.686054 6428 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:46.686179 6428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "2a277b56ac9e4b6bb3966ec47039721a"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "7187453732c1e2c131fbae81a6a02d39"
server_key_iv: "00dc7cccb049d3dc78ef4bd532d32b7b"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.686262 6428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:46.707659 6428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:46.710536 6428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:46.710701 6428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:46.710978 6428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:46.711501 6428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:46.711544 6428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:46.711572 6428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:46.711627 6428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:46.718974 6428 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:41717
I20260806 13:05:46.719080 6558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:41717 every 8 connection(s)
I20260806 13:05:46.719506 6428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
Aug 06 13:05:46 dist-test-slave-srgv krb5kdc[6320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021546, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:46.727816 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 6428
I20260806 13:05:46.727965 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:05:46.728276 21462 external_mini_cluster.cc:1428] Setting key 5bad6f1d18ebc8eb1bd184ab8c8a0713
I20260806 13:05:46.731966 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:46.720434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:37731 (local address 127.20.245.190:45851)
0806 13:05:46.720540 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:46.720542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:46.720781 (+ 239us) server_negotiation.cc:407] Connection header received
0806 13:05:46.721496 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:46.721498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:46.721524 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:46.721600 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:46.722958 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.723839 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.725097 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.725347 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.725417 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:46.728512 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:46.728514 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:46.728515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:46.728525 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:46.730324 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:46.730816 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:46.730817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:46.730818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:46.730893 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:46.731220 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:46.731221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:46.731222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:46.731358 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:46.731443 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:46.731754 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 13:05:46.731854 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 13:05:46.732254 6561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:46.720362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:45851 (local address 127.20.245.129:37731)
0806 13:05:46.720563 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:46.720611 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:46.721363 (+ 752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:46.721680 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:46.721684 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:46.722556 (+ 872us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:46.722834 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:46.722840 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.723964 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.723965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:46.724966 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:46.724969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.725451 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.725451 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:46.725584 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:46.726268 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:46.726279 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:46.728355 (+ 2076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:46.730425 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:46.730438 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:46.730441 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:46.730727 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:46.730973 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:46.730973 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:46.730974 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:46.731114 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:46.731432 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:46.731440 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:46.731607 (+ 167us) client_negotiation.cc:769] Sending connection context
0806 13:05:46.731732 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 13:05:46.731935 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":104,"threads_started":1}
I20260806 13:05:46.732909 6559 heartbeater.cc:347] Connected to a master server at 127.20.245.190:45851
I20260806 13:05:46.733057 6559 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:46.733320 6559 heartbeater.cc:511] Master 127.20.245.190:45851 requested a full tablet report, sending...
I20260806 13:05:46.734112 6365 ts_manager.cc:194] Registered new tserver with Master: 2a277b56ac9e4b6bb3966ec47039721a (127.20.245.129:41717)
I20260806 13:05:46.734930 6365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:37731
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:05:46.763501 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:45851
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:46.860898 6564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:46.861203 6564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:46.861235 6564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:46.862634 6564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:46.862676 6564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:46.862705 6564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:05:46.864444 6564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:45851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:46.864720 6564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:46.864964 6564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:46.871559 6569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:46.871559 6572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:46.871577 6570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:46.871770 6564 server_base.cc:1034] running on GCE node
I20260806 13:05:46.872112 6564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:46.872466 6564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:46.873646 6564 hybrid_clock.cc:648] HybridClock initialized: now 1786021546873635 us; error 52 us; skew 500 ppm
Aug 06 13:05:46 dist-test-slave-srgv krb5kdc[6320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021546, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:46.877061 6564 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:05:46.877660 6564 webserver.cc:460] Webserver started at http://127.20.245.130:33371/ using document root <none> and password file <none>
I20260806 13:05:46.877949 6564 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:46.878027 6564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:46.878204 6564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:46.879649 6564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "b931b1bff1cb4cc5b0e50d5701870eab"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "58b956330f8eb5e7b124e7e12c083552"
server_key_iv: "499390726a6f488c613fbdbdce360d04"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.880095 6564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "b931b1bff1cb4cc5b0e50d5701870eab"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "58b956330f8eb5e7b124e7e12c083552"
server_key_iv: "499390726a6f488c613fbdbdce360d04"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.881898 6564 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:46.882862 6579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:46.883117 6564 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:46.883262 6564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "b931b1bff1cb4cc5b0e50d5701870eab"
format_stamp: "Formatted at 2026-08-06 13:05:46 on dist-test-slave-srgv"
server_key: "58b956330f8eb5e7b124e7e12c083552"
server_key_iv: "499390726a6f488c613fbdbdce360d04"
server_key_version: "encryptionkey@0"
I20260806 13:05:46.883378 6564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:46.894874 6564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:46.898038 6564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:46.898255 6564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:46.898578 6564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:46.899003 6564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:46.899040 6564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:46.899066 6564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:46.899080 6564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:46.906148 6564 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:42507
I20260806 13:05:46.906227 6694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:42507 every 8 connection(s)
I20260806 13:05:46.906625 6564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:05:46.910997 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 6564
I20260806 13:05:46.911171 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:05:46.911473 21462 external_mini_cluster.cc:1428] Setting key 72937c1925a49fcd9b0ecdcb06221f78
Aug 06 13:05:46 dist-test-slave-srgv krb5kdc[6320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021546, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:46.919093 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:46.907574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:39811 (local address 127.20.245.190:45851)
0806 13:05:46.907654 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:46.907657 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:46.907856 (+ 199us) server_negotiation.cc:407] Connection header received
0806 13:05:46.908570 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:46.908572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:46.908589 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:46.908654 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:46.909771 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.910340 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.911640 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.911914 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.911997 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:46.914998 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:46.915001 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:46.915002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:46.915015 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:46.917104 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:46.917649 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:46.917651 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:46.917652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:46.917738 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:46.918099 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:46.918101 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:46.918102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:46.918302 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:46.918391 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:46.918793 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 13:05:46.918923 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 13:05:46.919281 6698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:46.907528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:45851 (local address 127.20.245.130:39811)
0806 13:05:46.907702 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:46.907752 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:46.908438 (+ 686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:46.908739 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:46.908743 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:46.909414 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:46.909653 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:46.909658 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.910449 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.910451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:46.911501 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:46.911523 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:46.912007 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:46.912008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:46.912159 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:46.912898 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:46.912910 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:46.914864 (+ 1954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:46.917227 (+ 2363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:46.917238 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:46.917240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:46.917546 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:46.917847 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:46.917848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:46.917849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:46.918007 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:46.918422 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:46.918431 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:46.918624 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 13:05:46.918745 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 13:05:46.918935 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260806 13:05:46.920073 6695 heartbeater.cc:347] Connected to a master server at 127.20.245.190:45851
I20260806 13:05:46.920265 6695 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:46.920537 6695 heartbeater.cc:511] Master 127.20.245.190:45851 requested a full tablet report, sending...
I20260806 13:05:46.921187 6365 ts_manager.cc:194] Registered new tserver with Master: b931b1bff1cb4cc5b0e50d5701870eab (127.20.245.130:42507)
I20260806 13:05:46.921826 6365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:39811
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:05:46.948828 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:45851
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:39291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:47.057657 6701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:47.057931 6701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:47.057960 6701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:47.059338 6701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:47.059389 6701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:47.059420 6701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:05:47.061003 6701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:39291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:45851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:47.061265 6701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:47.061499 6701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:47.067556 6707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:47.067796 6701 server_base.cc:1034] running on GCE node
W20260806 13:05:47.067492 6706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.067490 6709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:47.068236 6701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:47.068605 6701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:47.069835 6701 hybrid_clock.cc:648] HybridClock initialized: now 1786021547069820 us; error 65 us; skew 500 ppm
Aug 06 13:05:47 dist-test-slave-srgv krb5kdc[6320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021547, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:47.079949 6701 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:05:47.080720 6701 webserver.cc:460] Webserver started at http://127.20.245.131:46579/ using document root <none> and password file <none>
I20260806 13:05:47.081028 6701 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:47.081116 6701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:47.081319 6701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:47.082681 6701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "f820fc45c4de4bd0b032c79a4f28a1d0"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "50728da1c24858e935f6bc2e177356dc"
server_key_iv: "d0d1af7cc1e6d4ca01c7b851eea15815"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.083133 6701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "f820fc45c4de4bd0b032c79a4f28a1d0"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "50728da1c24858e935f6bc2e177356dc"
server_key_iv: "d0d1af7cc1e6d4ca01c7b851eea15815"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.084882 6701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:05:47.086022 6716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.086362 6701 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260806 13:05:47.086509 6701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "f820fc45c4de4bd0b032c79a4f28a1d0"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "50728da1c24858e935f6bc2e177356dc"
server_key_iv: "d0d1af7cc1e6d4ca01c7b851eea15815"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.086632 6701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:47.115741 6701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:47.118453 6701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:47.118610 6701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:47.118865 6701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:47.119364 6701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:47.119417 6701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.119444 6701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:47.119485 6701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.126785 6701 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:45127
I20260806 13:05:47.126842 6831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:45127 every 8 connection(s)
I20260806 13:05:47.127311 6701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:05:47.127558 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 6701
I20260806 13:05:47.127694 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:05:47.127952 21462 external_mini_cluster.cc:1428] Setting key 7a58a78be86272c31fdc96043d597cf6
Aug 06 13:05:47 dist-test-slave-srgv krb5kdc[6320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021547, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:47.138657 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.128371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:35153 (local address 127.20.245.190:45851)
0806 13:05:47.128442 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.128445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.128684 (+ 239us) server_negotiation.cc:407] Connection header received
0806 13:05:47.129306 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.129308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.129324 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.129380 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:47.130511 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.131077 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.132210 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.132431 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.132523 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.135444 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:47.135447 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:47.135447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:47.135457 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:47.137033 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:47.137527 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:47.137528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:47.137529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:47.137596 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:47.137882 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:47.137883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:47.137884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:47.138026 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:47.138110 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.138431 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.138544 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 13:05:47.138919 6834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.128319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:45851 (local address 127.20.245.131:35153)
0806 13:05:47.128520 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.128573 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:47.129183 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:47.129473 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:47.129478 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:47.130155 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:47.130396 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.130400 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.131203 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.131204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.132104 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.132107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.132535 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.132536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.132696 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.133350 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:47.133360 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:47.135307 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:47.137136 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:47.137147 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:47.137150 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:47.137437 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:47.137674 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:47.137675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:47.137675 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:47.137812 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:47.138095 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:47.138103 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:47.138278 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 13:05:47.138397 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 13:05:47.138596 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":100,"threads_started":1}
I20260806 13:05:47.139585 6832 heartbeater.cc:347] Connected to a master server at 127.20.245.190:45851
I20260806 13:05:47.139736 6832 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:47.140002 6832 heartbeater.cc:511] Master 127.20.245.190:45851 requested a full tablet report, sending...
I20260806 13:05:47.140491 6365 ts_manager.cc:194] Registered new tserver with Master: f820fc45c4de4bd0b032c79a4f28a1d0 (127.20.245.131:45127)
I20260806 13:05:47.140960 6365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:35153
I20260806 13:05:47.151618 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:05:47.161760 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.153463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37938 (local address 127.20.245.190:45851)
0806 13:05:47.153626 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.153629 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.153756 (+ 127us) server_negotiation.cc:407] Connection header received
0806 13:05:47.153895 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.153896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.153912 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.153996 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:47.154816 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.155551 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.156483 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.156732 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.156823 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.158513 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:47.158516 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:47.158516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:47.158527 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:47.160309 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:47.160762 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:47.160763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:47.160764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:47.160825 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:47.161044 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:47.161045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:47.161046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:47.161261 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:47.161385 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.161508 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.161614 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 13:05:47.164238 6365 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:05:47.166297 6365 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:05:47.174954 6844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.169719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:45127 (local address 127.0.0.1:44442)
0806 13:05:47.170106 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.170164 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:47.170265 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:47.170720 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:47.170721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:47.170723 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:47.170882 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.170886 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.172091 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.172093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.173619 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.173623 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.174585 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.174586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.174657 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.174662 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:47.174724 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 13:05:47.174822 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":18,"thread_start_us":117,"threads_started":1}
I20260806 13:05:47.174953 6848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.169994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43146 (local address 127.20.245.130:42507)
0806 13:05:47.170215 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.170221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.170518 (+ 297us) server_negotiation.cc:407] Connection header received
0806 13:05:47.170573 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.170576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.170595 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.170689 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:47.171097 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.172304 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.173800 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.174399 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.174510 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.174595 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.174782 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.174836 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":124,"threads_started":1}
I20260806 13:05:47.175161 6843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.169721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:42507 (local address 127.0.0.1:43146)
0806 13:05:47.170388 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.170398 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:47.170451 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:47.170708 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:47.170712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:47.170715 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:47.171003 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.171005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.172437 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.172439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.173715 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.173718 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.174521 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.174522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.174629 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.174648 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 13:05:47.174759 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 13:05:47.174822 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":55,"thread_start_us":99,"threads_started":1}
I20260806 13:05:47.175194 6847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.169916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44442 (local address 127.20.245.131:45127)
0806 13:05:47.170490 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.170499 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.170514 (+ 15us) server_negotiation.cc:407] Connection header received
0806 13:05:47.170571 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.170574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.170596 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.170820 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:47.170980 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.171948 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.173734 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.174487 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.174890 (+ 403us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.174970 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.175000 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.175063 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":117,"threads_started":1}
I20260806 13:05:47.175359 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.170076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57034 (local address 127.20.245.129:41717)
0806 13:05:47.170375 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.170379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.170541 (+ 162us) server_negotiation.cc:407] Connection header received
0806 13:05:47.170652 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.170654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.170672 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.170751 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:47.171003 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.172305 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.173557 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.174414 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.174505 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.174586 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.174790 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.174844 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":132,"threads_started":1}
I20260806 13:05:47.175442 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.169720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:41717 (local address 127.0.0.1:57034)
0806 13:05:47.170469 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.170482 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:47.170550 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:47.170856 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:47.170857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:47.170860 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:47.170935 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.170938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.172450 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.172451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.173453 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.173456 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.174617 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.174618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.174687 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.174691 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:47.174741 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 13:05:47.175361 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"mutex_wait_us":773,"thread_start_us":91,"threads_started":1}
I20260806 13:05:47.176832 6764 tablet_service.cc:1467] Processing CreateTablet for tablet e994cd557b39454e84e0291550542ce6 (DEFAULT_TABLE table=test-table [id=1adc26809924473baafaa0ed3e7edf66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:47.176774 6627 tablet_service.cc:1467] Processing CreateTablet for tablet e994cd557b39454e84e0291550542ce6 (DEFAULT_TABLE table=test-table [id=1adc26809924473baafaa0ed3e7edf66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:47.176972 6492 tablet_service.cc:1467] Processing CreateTablet for tablet e994cd557b39454e84e0291550542ce6 (DEFAULT_TABLE table=test-table [id=1adc26809924473baafaa0ed3e7edf66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:47.177304 6492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e994cd557b39454e84e0291550542ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:47.177304 6764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e994cd557b39454e84e0291550542ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:47.177306 6627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e994cd557b39454e84e0291550542ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:47.182487 6850 tablet_bootstrap.cc:492] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: Bootstrap starting.
I20260806 13:05:47.183650 6850 tablet_bootstrap.cc:654] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:47.184701 6850 log.cc:824] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:47.185276 6851 tablet_bootstrap.cc:492] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a: Bootstrap starting.
I20260806 13:05:47.185892 6850 tablet_bootstrap.cc:492] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: No bootstrap required, opened a new log
I20260806 13:05:47.185994 6850 ts_tablet_manager.cc:1397] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 13:05:47.187638 6852 tablet_bootstrap.cc:492] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab: Bootstrap starting.
I20260806 13:05:47.188552 6852 tablet_bootstrap.cc:654] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:47.188855 6850 raft_consensus.cc:348] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.189106 6850 raft_consensus.cc:374] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:47.189183 6850 raft_consensus.cc:729] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f820fc45c4de4bd0b032c79a4f28a1d0, State: Initialized, Role: FOLLOWER
I20260806 13:05:47.189308 6852 log.cc:824] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:47.189370 6850 consensus_queue.cc:260] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.189829 6850 ts_tablet_manager.cc:1428] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 13:05:47.190933 6852 tablet_bootstrap.cc:492] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab: No bootstrap required, opened a new log
I20260806 13:05:47.191097 6852 ts_tablet_manager.cc:1397] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 13:05:47.191097 6851 tablet_bootstrap.cc:654] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:47.192241 6851 log.cc:824] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:47.189865 6832 heartbeater.cc:503] Master 127.20.245.190:45851 was elected leader, sending a full tablet report...
I20260806 13:05:47.193710 6851 tablet_bootstrap.cc:492] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a: No bootstrap required, opened a new log
I20260806 13:05:47.193876 6851 ts_tablet_manager.cc:1397] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260806 13:05:47.193825 6852 raft_consensus.cc:348] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.194149 6852 raft_consensus.cc:374] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:47.194301 6852 raft_consensus.cc:729] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b931b1bff1cb4cc5b0e50d5701870eab, State: Initialized, Role: FOLLOWER
I20260806 13:05:47.194538 6852 consensus_queue.cc:260] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.194969 6852 ts_tablet_manager.cc:1428] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260806 13:05:47.195010 6695 heartbeater.cc:503] Master 127.20.245.190:45851 was elected leader, sending a full tablet report...
I20260806 13:05:47.197449 6851 raft_consensus.cc:348] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.197769 6851 raft_consensus.cc:374] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:47.197854 6851 raft_consensus.cc:729] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a277b56ac9e4b6bb3966ec47039721a, State: Initialized, Role: FOLLOWER
I20260806 13:05:47.198045 6851 consensus_queue.cc:260] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.198544 6851 ts_tablet_manager.cc:1428] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260806 13:05:47.198544 6559 heartbeater.cc:503] Master 127.20.245.190:45851 was elected leader, sending a full tablet report...
W20260806 13:05:47.220839 6560 tablet.cc:2369] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:47.249955 6855 raft_consensus.cc:482] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:47.250142 6855 raft_consensus.cc:504] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.250727 6855 leader_election.cc:288] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a277b56ac9e4b6bb3966ec47039721a (127.20.245.129:41717), b931b1bff1cb4cc5b0e50d5701870eab (127.20.245.130:42507)
I20260806 13:05:47.255023 6848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.251216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:58255 (local address 127.20.245.130:42507)
0806 13:05:47.251304 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.251307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.251320 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:05:47.251360 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.251362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.251386 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.251467 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:47.251656 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.252636 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.254028 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.254538 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.254643 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.254658 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.254848 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.254900 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 13:05:47.255033 6834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.251008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:42507 (local address 127.20.245.131:58255)
0806 13:05:47.251107 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.251120 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:47.251220 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:47.251480 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:47.251481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:47.251483 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:47.251566 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.251568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.252725 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.252726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.253911 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.253916 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.254650 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.254651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.254759 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.254763 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:47.254840 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 13:05:47.254895 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 13:05:47.255075 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.251115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:37415 (local address 127.20.245.129:41717)
0806 13:05:47.251263 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.251266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.251703 (+ 437us) server_negotiation.cc:407] Connection header received
0806 13:05:47.251798 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.251799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.251813 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.251854 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:47.252075 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.252635 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.254134 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.254615 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.254727 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.254740 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.254920 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.254976 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 13:05:47.255206 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.251008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:41717 (local address 127.20.245.131:37415)
0806 13:05:47.251628 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.251642 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:47.251713 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:47.251880 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:47.251881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:47.251883 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:47.251965 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.251966 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.252795 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.252796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.253918 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.253922 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.254728 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.254729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.254813 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.254818 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:47.254906 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 13:05:47.254951 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":273,"thread_start_us":146,"threads_started":1}
I20260806 13:05:47.255928 6648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e994cd557b39454e84e0291550542ce6" candidate_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" is_pre_election: true
I20260806 13:05:47.255926 6512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e994cd557b39454e84e0291550542ce6" candidate_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a277b56ac9e4b6bb3966ec47039721a" is_pre_election: true
I20260806 13:05:47.256171 6648 raft_consensus.cc:2454] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f820fc45c4de4bd0b032c79a4f28a1d0 in term 0.
I20260806 13:05:47.256197 6512 raft_consensus.cc:2454] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f820fc45c4de4bd0b032c79a4f28a1d0 in term 0.
I20260806 13:05:47.256448 6717 leader_election.cc:302] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a277b56ac9e4b6bb3966ec47039721a, f820fc45c4de4bd0b032c79a4f28a1d0; no voters:
I20260806 13:05:47.256675 6855 raft_consensus.cc:2781] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:05:47.256723 6855 raft_consensus.cc:482] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:05:47.256742 6855 raft_consensus.cc:3037] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:47.257715 6855 raft_consensus.cc:504] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.257902 6855 leader_election.cc:288] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2a277b56ac9e4b6bb3966ec47039721a (127.20.245.129:41717), b931b1bff1cb4cc5b0e50d5701870eab (127.20.245.130:42507)
I20260806 13:05:47.258163 6648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e994cd557b39454e84e0291550542ce6" candidate_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b931b1bff1cb4cc5b0e50d5701870eab"
I20260806 13:05:47.258229 6512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e994cd557b39454e84e0291550542ce6" candidate_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a277b56ac9e4b6bb3966ec47039721a"
I20260806 13:05:47.258285 6648 raft_consensus.cc:3037] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:47.258322 6512 raft_consensus.cc:3037] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:47.259517 6648 raft_consensus.cc:2454] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f820fc45c4de4bd0b032c79a4f28a1d0 in term 1.
I20260806 13:05:47.259517 6512 raft_consensus.cc:2454] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f820fc45c4de4bd0b032c79a4f28a1d0 in term 1.
I20260806 13:05:47.259788 6717 leader_election.cc:302] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a277b56ac9e4b6bb3966ec47039721a, f820fc45c4de4bd0b032c79a4f28a1d0; no voters:
I20260806 13:05:47.259974 6855 raft_consensus.cc:2781] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:47.260246 6855 raft_consensus.cc:686] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 1 LEADER]: Becoming Leader. State: Replica: f820fc45c4de4bd0b032c79a4f28a1d0, State: Running, Role: LEADER
I20260806 13:05:47.260396 6855 consensus_queue.cc:237] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } }
I20260806 13:05:47.261658 6365 catalog_manager.cc:5495] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to f820fc45c4de4bd0b032c79a4f28a1d0 (127.20.245.131). New cstate: current_term: 1 leader_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f820fc45c4de4bd0b032c79a4f28a1d0" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 45127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260806 13:05:47.274331 6847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.271384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44458 (local address 127.20.245.131:45127)
0806 13:05:47.271451 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.271458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.271467 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:05:47.271515 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.271516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.271540 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.271609 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:05:47.271773 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.272295 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.273195 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.273419 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.273490 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.273779 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:05:47.273930 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:05:47.274017 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.274117 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.274147 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 13:05:47.277077 6512 raft_consensus.cc:1261] T e994cd557b39454e84e0291550542ce6 P 2a277b56ac9e4b6bb3966ec47039721a [term 1 FOLLOWER]: Refusing update from remote peer f820fc45c4de4bd0b032c79a4f28a1d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:47.277073 6648 raft_consensus.cc:1261] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 1 FOLLOWER]: Refusing update from remote peer f820fc45c4de4bd0b032c79a4f28a1d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:47.277706 6860 consensus_queue.cc:1035] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a277b56ac9e4b6bb3966ec47039721a" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:47.277927 6855 consensus_queue.cc:1035] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b931b1bff1cb4cc5b0e50d5701870eab" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:47.281409 6863 mvcc.cc:205] Tried to move back new op lower bound from 7315544257642827776 to 7315544257579569152. Current Snapshot: MvccSnapshot[applied={T|T < 7315544257642827776}]
I20260806 13:05:47.281878 6865 mvcc.cc:205] Tried to move back new op lower bound from 7315544257642827776 to 7315544257579569152. Current Snapshot: MvccSnapshot[applied={T|T < 7315544257642827776}]
I20260806 13:05:47.282400 6864 mvcc.cc:205] Tried to move back new op lower bound from 7315544257642827776 to 7315544257579569152. Current Snapshot: MvccSnapshot[applied={T|T < 7315544257642827776}]
I20260806 13:05:47.285835 6364 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:47.285979 6364 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:47.287127 6364 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3eb754b460c142f1aaac295468d7da51: Sending DeleteTablet for 3 replicas of tablet e994cd557b39454e84e0291550542ce6
I20260806 13:05:47.287657 6764 tablet_service.cc:1514] Processing DeleteTablet for tablet e994cd557b39454e84e0291550542ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:47 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:44442
I20260806 13:05:47.287667 6627 tablet_service.cc:1514] Processing DeleteTablet for tablet e994cd557b39454e84e0291550542ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:47 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:43146
I20260806 13:05:47.288049 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 6428
I20260806 13:05:47.288025 6492 tablet_service.cc:1514] Processing DeleteTablet for tablet e994cd557b39454e84e0291550542ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:47 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:57034
I20260806 13:05:47.295976 6873 tablet_replica.cc:330] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: stopping tablet replica
I20260806 13:05:47.296245 6873 raft_consensus.cc:2229] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:05:47.296487 6873 raft_consensus.cc:2258] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:47.296783 6874 tablet_replica.cc:330] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab: stopping tablet replica
I20260806 13:05:47.296975 6874 raft_consensus.cc:2229] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:47.297155 6874 raft_consensus.cc:2258] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:47.297643 6873 ts_tablet_manager.cc:1905] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:47.297785 6874 ts_tablet_manager.cc:1905] T e994cd557b39454e84e0291550542ce6 P b931b1bff1cb4cc5b0e50d5701870eab: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 13:05:47.298039 6349 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:41717 (error 108)
I20260806 13:05:47.299013 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 6564
I20260806 13:05:47.301326 6873 ts_tablet_manager.cc:1918] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:47.301555 6873 log.cc:1196] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/e994cd557b39454e84e0291550542ce6
I20260806 13:05:47.302008 6873 ts_tablet_manager.cc:1939] T e994cd557b39454e84e0291550542ce6 P f820fc45c4de4bd0b032c79a4f28a1d0: Deleting consensus metadata
I20260806 13:05:47.302718 6352 catalog_manager.cc:4841] TS f820fc45c4de4bd0b032c79a4f28a1d0 (127.20.245.131:45127): tablet e994cd557b39454e84e0291550542ce6 (table test-table [id=1adc26809924473baafaa0ed3e7edf66]) successfully deleted
I20260806 13:05:47.303624 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.303428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:41717 (local address 127.0.0.1:57036)
0806 13:05:47.303506 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.303572 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:41717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 13:05:47.303828 6349 catalog_manager.cc:4584] TS 2a277b56ac9e4b6bb3966ec47039721a (127.20.245.129:41717): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e994cd557b39454e84e0291550542ce6: Network error: Client connection negotiation failed: client connection to 127.20.245.129:41717: connect: Connection refused (error 111)
I20260806 13:05:47.308243 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 6701
I20260806 13:05:47.309336 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.308385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:42507 (local address 127.0.0.1:43158)
0806 13:05:47.309227 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.309272 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.130:42507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":810}
I20260806 13:05:47.314870 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 6333
2026-08-06T13:05:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2280 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T13:05:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:47Z Disabled control of system clock
I20260806 13:05:47.350898 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:37601
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:38335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:37601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 13:05:47.450080 6879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:47.450423 6879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:47.450450 6879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:47.452323 6879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:47.452414 6879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:47.452430 6879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:47.452447 6879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:47.452461 6879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:47.454412 6879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:38335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:37601
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:37601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:47.454721 6879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:47.455090 6879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:47.461264 6887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.461259 6884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.461259 6885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:47.461293 6879 server_base.cc:1034] running on GCE node
I20260806 13:05:47.461870 6879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:47.462208 6879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:47.463372 6879 hybrid_clock.cc:648] HybridClock initialized: now 1786021547463346 us; error 39 us; skew 500 ppm
I20260806 13:05:47.465129 6879 webserver.cc:460] Webserver started at http://127.20.245.190:45911/ using document root <none> and password file <none>
I20260806 13:05:47.465520 6879 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:47.465586 6879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:47.465770 6879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:47.467403 6879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "234da1c5e2064e1da7afc6508b31e030"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "b84eb924e545593d707d50345ddf521b"
server_key_iv: "62c23b40832cfe189661a82fd1b6ac77"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.467878 6879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "234da1c5e2064e1da7afc6508b31e030"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "b84eb924e545593d707d50345ddf521b"
server_key_iv: "62c23b40832cfe189661a82fd1b6ac77"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.469640 6879 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 13:05:47.470808 6894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.471110 6879 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:47.471285 6879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "234da1c5e2064e1da7afc6508b31e030"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "b84eb924e545593d707d50345ddf521b"
server_key_iv: "62c23b40832cfe189661a82fd1b6ac77"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.471390 6879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:47.489539 6879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:47.490129 6879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:47.490511 6879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:47.496189 6879 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:37601
I20260806 13:05:47.496244 6947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:37601 every 8 connection(s)
I20260806 13:05:47.496745 6879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:47.497560 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 6879
I20260806 13:05:47.497748 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:47.498000 21462 external_mini_cluster.cc:1428] Setting key 9264930ecf6f73175a577a1e77f57831
I20260806 13:05:47.498224 6948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:47.502566 6948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030: Bootstrap starting.
I20260806 13:05:47.503502 6948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:47.503918 6948 log.cc:824] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:47.504812 6948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030: No bootstrap required, opened a new log
I20260806 13:05:47.505446 6951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.498798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56534 (local address 127.20.245.190:37601)
0806 13:05:47.499045 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.499054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.499088 (+ 34us) server_negotiation.cc:407] Connection header received
0806 13:05:47.499782 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.499792 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.499879 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.500038 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:47.500361 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.501383 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.502572 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.503338 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.503460 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.504546 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:47.504552 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:47.504552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:47.504812 (+ 260us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:47.504888 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:47.504909 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:47.504991 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.505099 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.505217 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":114,"threads_started":1}
I20260806 13:05:47.507278 6948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "234da1c5e2064e1da7afc6508b31e030" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37601 } }
I20260806 13:05:47.507459 6948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:47.507484 6948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234da1c5e2064e1da7afc6508b31e030, State: Initialized, Role: FOLLOWER
I20260806 13:05:47.507638 6948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "234da1c5e2064e1da7afc6508b31e030" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37601 } }
I20260806 13:05:47.507733 6948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:47.507759 6948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:47.507831 6948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:47.508596 6948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "234da1c5e2064e1da7afc6508b31e030" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37601 } }
I20260806 13:05:47.508737 6948 leader_election.cc:302] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 234da1c5e2064e1da7afc6508b31e030; no voters:
I20260806 13:05:47.508997 6948 leader_election.cc:288] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:47.509083 6953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:47.509341 6953 raft_consensus.cc:686] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [term 1 LEADER]: Becoming Leader. State: Replica: 234da1c5e2064e1da7afc6508b31e030, State: Running, Role: LEADER
I20260806 13:05:47.509392 6948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:47.509470 6953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "234da1c5e2064e1da7afc6508b31e030" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37601 } }
I20260806 13:05:47.509974 6954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "234da1c5e2064e1da7afc6508b31e030" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "234da1c5e2064e1da7afc6508b31e030" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37601 } } }
I20260806 13:05:47.509987 6955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 234da1c5e2064e1da7afc6508b31e030. Latest consensus state: current_term: 1 leader_uuid: "234da1c5e2064e1da7afc6508b31e030" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "234da1c5e2064e1da7afc6508b31e030" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 37601 } } }
I20260806 13:05:47.510221 6955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:47.510483 6962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:47.510720 6954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:47.511129 6962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:47.512984 6962 catalog_manager.cc:1347] Generated new cluster ID: 9a9a037209414f7e8a698e1981b0afbc
I20260806 13:05:47.513051 6962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:05:47.531679 6962 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:47.532394 6962 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:47.537544 6962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030: Generated new TSK 0
I20260806 13:05:47.537907 6962 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:05:47.550148 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37601
--builtin_ntp_servers=127.20.245.148:38335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 13:05:47.668948 6972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:47.669284 6972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:47.669330 6972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:47.670802 6972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:47.670883 6972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:47.670933 6972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:05:47.672603 6972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:38335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:47.672962 6972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:47.673368 6972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:47.680312 6978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.680327 6980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.680325 6977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:47.680742 6972 server_base.cc:1034] running on GCE node
I20260806 13:05:47.680950 6972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:47.681226 6972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:47.682399 6972 hybrid_clock.cc:648] HybridClock initialized: now 1786021547682385 us; error 35 us; skew 500 ppm
I20260806 13:05:47.684298 6972 webserver.cc:460] Webserver started at http://127.20.245.129:41999/ using document root <none> and password file <none>
I20260806 13:05:47.684688 6972 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:47.684782 6972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:47.684973 6972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:47.686383 6972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "5948c46c0fd74faba47a1fe9123796d6"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "47b1bb68cc1361f183e800d4a015b46d"
server_key_iv: "a6f74fa7e944cee9226170a2df94937f"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.686833 6972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "5948c46c0fd74faba47a1fe9123796d6"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "47b1bb68cc1361f183e800d4a015b46d"
server_key_iv: "a6f74fa7e944cee9226170a2df94937f"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.688611 6972 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 13:05:47.689702 6987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.689956 6972 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:47.690083 6972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "5948c46c0fd74faba47a1fe9123796d6"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "47b1bb68cc1361f183e800d4a015b46d"
server_key_iv: "a6f74fa7e944cee9226170a2df94937f"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.690228 6972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:47.700188 6972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:47.700580 6972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:47.700743 6972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:47.701014 6972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:47.701406 6972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:47.701463 6972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.701514 6972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:47.701543 6972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.708642 6972 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:36079
I20260806 13:05:47.708727 7101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:36079 every 8 connection(s)
I20260806 13:05:47.709172 6972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:05:47.716061 6951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.710167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:56145 (local address 127.20.245.190:37601)
0806 13:05:47.710237 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.710240 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.710653 (+ 413us) server_negotiation.cc:407] Connection header received
0806 13:05:47.711429 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.711430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.711447 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.711508 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:47.712336 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.712928 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.714069 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.714299 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.714393 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.715586 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:47.715588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:47.715589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:47.715596 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:47.715615 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:47.715620 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:47.715696 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.715838 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.715931 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 13:05:47.716322 7104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.710185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:37601 (local address 127.20.245.129:56145)
0806 13:05:47.710443 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.710531 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:47.711287 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:47.711599 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:47.711604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:47.711619 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:47.712227 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.712232 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.713049 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.713050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.713959 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.713963 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.714407 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.714408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.714572 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.715364 (+ 792us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:47.715364 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:47.715405 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:47.715440 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:47.715697 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:47.715706 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:47.715711 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:47.715813 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 13:05:47.715978 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":132,"threads_started":1}
I20260806 13:05:47.717027 7102 heartbeater.cc:347] Connected to a master server at 127.20.245.190:37601
I20260806 13:05:47.717173 7102 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:47.717440 7102 heartbeater.cc:511] Master 127.20.245.190:37601 requested a full tablet report, sending...
I20260806 13:05:47.718175 6911 ts_manager.cc:194] Registered new tserver with Master: 5948c46c0fd74faba47a1fe9123796d6 (127.20.245.129:36079)
I20260806 13:05:47.718698 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 6972
I20260806 13:05:47.718832 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:05:47.719066 21462 external_mini_cluster.cc:1428] Setting key 6d9b9142e6394bdba9c22afe8a3f9e47
I20260806 13:05:47.719220 6911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.129:56145
I20260806 13:05:47.720254 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37601
--builtin_ntp_servers=127.20.245.148:38335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 13:05:47.817238 7105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:47.817548 7105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:47.817588 7105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:47.818933 7105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:47.819021 7105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:47.819068 7105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:05:47.820922 7105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:38335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:47.821370 7105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:47.821796 7105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:47.828003 7110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.828073 7113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.828003 7111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:47.828353 7105 server_base.cc:1034] running on GCE node
I20260806 13:05:47.828630 7105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:47.828958 7105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:47.830116 7105 hybrid_clock.cc:648] HybridClock initialized: now 1786021547830102 us; error 32 us; skew 500 ppm
I20260806 13:05:47.831811 7105 webserver.cc:460] Webserver started at http://127.20.245.130:36235/ using document root <none> and password file <none>
I20260806 13:05:47.832149 7105 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:47.832206 7105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:47.832365 7105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:47.833765 7105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "d7b53bfa2e0040078da36b426e122abc"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "ec6208c6aa34751814e4f5ed2d14db8f"
server_key_iv: "edc10f9740951c6999a5d7269f9d1f68"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.834228 7105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "d7b53bfa2e0040078da36b426e122abc"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "ec6208c6aa34751814e4f5ed2d14db8f"
server_key_iv: "edc10f9740951c6999a5d7269f9d1f68"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.836081 7105 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260806 13:05:47.837157 7119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.837422 7105 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:47.837539 7105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "d7b53bfa2e0040078da36b426e122abc"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "ec6208c6aa34751814e4f5ed2d14db8f"
server_key_iv: "edc10f9740951c6999a5d7269f9d1f68"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.837672 7105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:47.854496 7105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:47.855011 7105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:47.855304 7105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:47.855630 7105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:47.856106 7105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:47.856143 7105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.856170 7105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:47.856182 7105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.863585 7105 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:35309
I20260806 13:05:47.863626 7234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:35309 every 8 connection(s)
I20260806 13:05:47.864061 7105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:05:47.867314 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 7105
I20260806 13:05:47.867424 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:05:47.867671 21462 external_mini_cluster.cc:1428] Setting key c64822ec801e5f323ecedfc7073ef1a5
I20260806 13:05:47.868924 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37601
--builtin_ntp_servers=127.20.245.148:38335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 13:05:47.870743 6951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.864981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:51327 (local address 127.20.245.190:37601)
0806 13:05:47.865059 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:47.865062 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:47.865366 (+ 304us) server_negotiation.cc:407] Connection header received
0806 13:05:47.865950 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:47.865952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:47.865964 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:47.866034 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:47.866886 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.867601 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.868895 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.869224 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.869305 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.870433 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:47.870435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:47.870435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:47.870440 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:47.870456 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:47.870460 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:47.870509 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:47.870617 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 13:05:47.870649 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:05:47.871268 7237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:47.864979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:37601 (local address 127.20.245.130:51327)
0806 13:05:47.865209 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:47.865259 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:47.865852 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:47.866123 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:47.866127 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:47.866137 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:47.866795 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.866800 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.867711 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.867712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.868785 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:47.868788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:47.869326 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:47.869327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:47.869524 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:47.870242 (+ 718us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:47.870243 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:47.870293 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:47.870331 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:47.870526 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:47.870534 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:47.870538 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:47.870614 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 13:05:47.870763 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":112,"threads_started":1}
I20260806 13:05:47.871862 7235 heartbeater.cc:347] Connected to a master server at 127.20.245.190:37601
I20260806 13:05:47.872015 7235 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:47.872291 7235 heartbeater.cc:511] Master 127.20.245.190:37601 requested a full tablet report, sending...
I20260806 13:05:47.872785 6911 ts_manager.cc:194] Registered new tserver with Master: d7b53bfa2e0040078da36b426e122abc (127.20.245.130:35309)
I20260806 13:05:47.873282 6911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.130:51327
W20260806 13:05:47.966063 7238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:47.966328 7238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:47.966354 7238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:47.967803 7238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:47.967851 7238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:47.967880 7238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:05:47.969357 7238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:38335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:37601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:47.969677 7238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:47.970077 7238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:47.976181 7244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.976191 7246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:47.976190 7243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:47.976918 7238 server_base.cc:1034] running on GCE node
I20260806 13:05:47.977201 7238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:47.977521 7238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:47.978757 7238 hybrid_clock.cc:648] HybridClock initialized: now 1786021547978726 us; error 36 us; skew 500 ppm
I20260806 13:05:47.980399 7238 webserver.cc:460] Webserver started at http://127.20.245.131:36491/ using document root <none> and password file <none>
I20260806 13:05:47.980738 7238 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:47.980815 7238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:47.980996 7238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:47.982254 7238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "208de0dff3474bafb4309fe6d3704d78"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "b8ad77cd47cd2ace71bf1cd9db44defa"
server_key_iv: "0b8e34bdeb9a060c63772240609c7842"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.982682 7238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "208de0dff3474bafb4309fe6d3704d78"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "b8ad77cd47cd2ace71bf1cd9db44defa"
server_key_iv: "0b8e34bdeb9a060c63772240609c7842"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.984396 7238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 13:05:47.985411 7252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.985656 7238 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:47.985767 7238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "208de0dff3474bafb4309fe6d3704d78"
format_stamp: "Formatted at 2026-08-06 13:05:47 on dist-test-slave-srgv"
server_key: "b8ad77cd47cd2ace71bf1cd9db44defa"
server_key_iv: "0b8e34bdeb9a060c63772240609c7842"
server_key_version: "encryptionkey@0"
I20260806 13:05:47.985877 7238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:47.996073 7238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:47.996555 7238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:47.996771 7238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:47.997092 7238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:47.997524 7238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:47.997596 7238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:47.997645 7238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:47.997697 7238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:48.005760 7238 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:35557
I20260806 13:05:48.005800 7367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:35557 every 8 connection(s)
I20260806 13:05:48.006304 7238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:05:48.007347 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 7238
I20260806 13:05:48.007500 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:05:48.007722 21462 external_mini_cluster.cc:1428] Setting key 92875de76de700e45b9536f3f16ef4d0
I20260806 13:05:48.013979 6951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.007467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:58569 (local address 127.20.245.190:37601)
0806 13:05:48.007551 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:48.007554 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:48.008014 (+ 460us) server_negotiation.cc:407] Connection header received
0806 13:05:48.008808 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:48.008810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:48.008826 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:48.008895 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:48.009907 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.010695 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.012032 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.012271 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.012376 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.013585 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:48.013587 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:48.013587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:48.013595 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:48.013620 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:48.013631 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:48.013714 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:48.013825 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 13:05:48.013866 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:05:48.014308 7370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.007460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:37601 (local address 127.20.245.131:58569)
0806 13:05:48.007834 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:48.007893 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:48.008695 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:48.008989 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:48.008994 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:48.009012 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:48.009788 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.009795 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.010825 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.010826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.011900 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.011904 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.012400 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.012401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.012587 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.013365 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:48.013366 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:48.013405 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:48.013445 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:48.013708 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:48.013717 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:48.013722 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:48.013828 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 13:05:48.013972 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":100,"threads_started":1}
I20260806 13:05:48.014884 7368 heartbeater.cc:347] Connected to a master server at 127.20.245.190:37601
I20260806 13:05:48.015034 7368 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:48.015400 7368 heartbeater.cc:511] Master 127.20.245.190:37601 requested a full tablet report, sending...
I20260806 13:05:48.016047 6911 ts_manager.cc:194] Registered new tserver with Master: 208de0dff3474bafb4309fe6d3704d78 (127.20.245.131:35557)
I20260806 13:05:48.016711 6911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.131:58569
I20260806 13:05:48.020120 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:05:48.025662 6951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.021975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56540 (local address 127.20.245.190:37601)
0806 13:05:48.022044 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:48.022046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:48.022178 (+ 132us) server_negotiation.cc:407] Connection header received
0806 13:05:48.022211 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:48.022212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:48.022224 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:48.022293 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:48.022452 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.022995 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.024174 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.024376 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.024442 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.025317 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:48.025319 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:48.025319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:48.025335 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:48.025357 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:48.025361 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:48.025420 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:48.025503 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 13:05:48.025541 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 13:05:48.028081 6911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:05:48.030333 6911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:05:48.039031 7381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.034350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42852 (local address 127.20.245.129:36079)
0806 13:05:48.034694 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:48.034700 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:48.034711 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:05:48.034777 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:48.034778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:48.034793 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:48.034868 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:48.035107 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.036530 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.037672 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.038465 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.038554 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.038674 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:48.038857 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 13:05:48.038908 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":115,"threads_started":1}
I20260806 13:05:48.039059 7377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.034092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:36079 (local address 127.0.0.1:42852)
0806 13:05:48.034560 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:48.034568 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:48.034615 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:48.034905 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:48.034909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:48.034912 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:48.035016 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.035020 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.036653 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.036654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.037562 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.037565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.038580 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.038581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.038673 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.038689 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 13:05:48.038823 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 13:05:48.038920 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":56,"thread_start_us":58,"threads_started":1}
I20260806 13:05:48.039541 7376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.033804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:35557 (local address 127.0.0.1:58884)
0806 13:05:48.034306 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:48.034362 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:48.034458 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:48.034967 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:48.034968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:48.034971 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:48.035042 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.035043 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.036653 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.036654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.037885 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.037888 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.039232 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.039233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.039328 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.039333 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:48.039397 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 13:05:48.039454 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":89,"thread_start_us":123,"threads_started":1}
I20260806 13:05:48.039575 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.033995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58884 (local address 127.20.245.131:35557)
0806 13:05:48.034767 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:48.034772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:48.034782 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:05:48.034826 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:48.034828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:48.034854 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:48.034945 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:48.035160 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.036535 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.037987 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.038749 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.038844 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.038928 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:48.039419 (+ 491us) server_negotiation.cc:299] Negotiation successful
0806 13:05:48.039474 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":255,"threads_started":1}
I20260806 13:05:48.040068 7035 tablet_service.cc:1467] Processing CreateTablet for tablet db9d8896c80f474b88b1dee32467fb5b (DEFAULT_TABLE table=test-table [id=7f253654421444d5a9e0db1b0157f116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:48.040637 7035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db9d8896c80f474b88b1dee32467fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:48.041013 7378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.033830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:35309 (local address 127.0.0.1:54184)
0806 13:05:48.034408 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:48.034417 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:48.034464 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:48.035353 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:48.035354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:48.035356 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:48.035411 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.035412 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.036433 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.036434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.037885 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.037888 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.040751 (+ 2863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.040752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.040833 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.040844 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 13:05:48.040903 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 13:05:48.040951 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":103,"threads_started":1}
I20260806 13:05:48.041091 7379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.034084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54184 (local address 127.20.245.130:35309)
0806 13:05:48.035123 (+ 1039us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:48.035127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:48.035137 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:05:48.035231 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:48.035233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:48.035251 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:48.035343 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:48.035492 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.036259 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.038983 (+ 2724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.040540 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.040636 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.040784 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:48.040941 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 13:05:48.040996 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":983,"thread_start_us":120,"threads_started":1}
I20260806 13:05:48.041914 7169 tablet_service.cc:1467] Processing CreateTablet for tablet db9d8896c80f474b88b1dee32467fb5b (DEFAULT_TABLE table=test-table [id=7f253654421444d5a9e0db1b0157f116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:48.042361 7169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db9d8896c80f474b88b1dee32467fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:48.044075 7302 tablet_service.cc:1467] Processing CreateTablet for tablet db9d8896c80f474b88b1dee32467fb5b (DEFAULT_TABLE table=test-table [id=7f253654421444d5a9e0db1b0157f116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:48.044525 7302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db9d8896c80f474b88b1dee32467fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:48.044708 7382 tablet_bootstrap.cc:492] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6: Bootstrap starting.
I20260806 13:05:48.045532 7382 tablet_bootstrap.cc:654] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:48.045949 7382 log.cc:824] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:48.046082 7383 tablet_bootstrap.cc:492] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Bootstrap starting.
I20260806 13:05:48.046789 7383 tablet_bootstrap.cc:654] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:48.047124 7382 tablet_bootstrap.cc:492] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6: No bootstrap required, opened a new log
I20260806 13:05:48.047127 7383 log.cc:824] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:48.047233 7382 ts_tablet_manager.cc:1397] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:05:48.048000 7383 tablet_bootstrap.cc:492] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: No bootstrap required, opened a new log
I20260806 13:05:48.048084 7383 ts_tablet_manager.cc:1397] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:05:48.048439 7386 tablet_bootstrap.cc:492] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Bootstrap starting.
I20260806 13:05:48.049019 7386 tablet_bootstrap.cc:654] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:48.049340 7386 log.cc:824] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:48.050150 7386 tablet_bootstrap.cc:492] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: No bootstrap required, opened a new log
I20260806 13:05:48.050232 7386 ts_tablet_manager.cc:1397] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 13:05:48.050205 7382 raft_consensus.cc:348] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.050411 7382 raft_consensus.cc:374] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:48.050457 7382 raft_consensus.cc:729] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5948c46c0fd74faba47a1fe9123796d6, State: Initialized, Role: FOLLOWER
I20260806 13:05:48.050627 7382 consensus_queue.cc:260] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.050961 7382 ts_tablet_manager.cc:1428] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 13:05:48.050989 7383 raft_consensus.cc:348] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.051159 7383 raft_consensus.cc:374] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:48.051198 7102 heartbeater.cc:503] Master 127.20.245.190:37601 was elected leader, sending a full tablet report...
I20260806 13:05:48.051245 7383 raft_consensus.cc:729] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b53bfa2e0040078da36b426e122abc, State: Initialized, Role: FOLLOWER
I20260806 13:05:48.051366 7383 consensus_queue.cc:260] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.051652 7383 ts_tablet_manager.cc:1428] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260806 13:05:48.051678 7235 heartbeater.cc:503] Master 127.20.245.190:37601 was elected leader, sending a full tablet report...
I20260806 13:05:48.053463 7386 raft_consensus.cc:348] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.053637 7386 raft_consensus.cc:374] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:48.053687 7386 raft_consensus.cc:729] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208de0dff3474bafb4309fe6d3704d78, State: Initialized, Role: FOLLOWER
I20260806 13:05:48.053812 7386 consensus_queue.cc:260] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.054083 7386 ts_tablet_manager.cc:1428] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260806 13:05:48.054263 7368 heartbeater.cc:503] Master 127.20.245.190:37601 was elected leader, sending a full tablet report...
W20260806 13:05:48.114811 7236 tablet.cc:2369] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 13:05:48.210299 7103 tablet.cc:2369] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:48.211442 7388 raft_consensus.cc:482] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:48.211599 7388 raft_consensus.cc:504] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.212033 7388 leader_election.cc:288] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 208de0dff3474bafb4309fe6d3704d78 (127.20.245.131:35557), d7b53bfa2e0040078da36b426e122abc (127.20.245.130:35309)
I20260806 13:05:48.215502 7379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.212485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:32839 (local address 127.20.245.130:35309)
0806 13:05:48.212537 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:48.212540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:48.212552 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:05:48.212596 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:48.212597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:48.212615 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:48.212676 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:48.212957 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.213539 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.214683 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.215065 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.215123 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.215132 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:48.215362 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 13:05:48.215415 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 13:05:48.215526 7104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.212317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:35309 (local address 127.20.245.129:32839)
0806 13:05:48.212414 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:48.212434 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:48.212518 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:48.212738 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:48.212740 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:48.212743 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:48.212851 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.212853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.213633 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.213634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.214563 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.214566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.215154 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.215155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.215287 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.215291 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:48.215337 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 13:05:48.215382 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":3}
I20260806 13:05:48.215552 7391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.212317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:35557 (local address 127.20.245.129:56625)
0806 13:05:48.212579 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:48.212590 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:48.212665 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:48.212869 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:48.212869 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:48.212871 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:48.212971 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.212973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.213725 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.213726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.214570 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:48.214572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.215228 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.215229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:48.215315 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.215336 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 13:05:48.215410 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 13:05:48.215452 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":110,"thread_start_us":89,"threads_started":1}
I20260806 13:05:48.215571 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.212460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:56625 (local address 127.20.245.131:35557)
0806 13:05:48.212518 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:48.212521 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:48.212703 (+ 182us) server_negotiation.cc:407] Connection header received
0806 13:05:48.212749 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:48.212750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:48.212763 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:48.212860 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:48.213057 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.213621 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.214697 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.215085 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.215206 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.215216 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:48.215434 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 13:05:48.215489 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 13:05:48.215975 7322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db9d8896c80f474b88b1dee32467fb5b" candidate_uuid: "5948c46c0fd74faba47a1fe9123796d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208de0dff3474bafb4309fe6d3704d78" is_pre_election: true
I20260806 13:05:48.216029 7189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db9d8896c80f474b88b1dee32467fb5b" candidate_uuid: "5948c46c0fd74faba47a1fe9123796d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b53bfa2e0040078da36b426e122abc" is_pre_election: true
I20260806 13:05:48.216204 7322 raft_consensus.cc:2454] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5948c46c0fd74faba47a1fe9123796d6 in term 0.
I20260806 13:05:48.216228 7189 raft_consensus.cc:2454] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5948c46c0fd74faba47a1fe9123796d6 in term 0.
I20260806 13:05:48.216526 6990 leader_election.cc:302] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208de0dff3474bafb4309fe6d3704d78, 5948c46c0fd74faba47a1fe9123796d6; no voters:
I20260806 13:05:48.216703 7388 raft_consensus.cc:2781] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:05:48.216768 7388 raft_consensus.cc:482] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:05:48.216794 7388 raft_consensus.cc:3037] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:48.217953 7388 raft_consensus.cc:504] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.218132 7388 leader_election.cc:288] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [CANDIDATE]: Term 1 election: Requested vote from peers 208de0dff3474bafb4309fe6d3704d78 (127.20.245.131:35557), d7b53bfa2e0040078da36b426e122abc (127.20.245.130:35309)
I20260806 13:05:48.218349 7322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db9d8896c80f474b88b1dee32467fb5b" candidate_uuid: "5948c46c0fd74faba47a1fe9123796d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208de0dff3474bafb4309fe6d3704d78"
I20260806 13:05:48.218408 7189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db9d8896c80f474b88b1dee32467fb5b" candidate_uuid: "5948c46c0fd74faba47a1fe9123796d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b53bfa2e0040078da36b426e122abc"
I20260806 13:05:48.218477 7322 raft_consensus.cc:3037] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:48.218511 7189 raft_consensus.cc:3037] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:48.219806 7322 raft_consensus.cc:2454] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5948c46c0fd74faba47a1fe9123796d6 in term 1.
I20260806 13:05:48.219807 7189 raft_consensus.cc:2454] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5948c46c0fd74faba47a1fe9123796d6 in term 1.
I20260806 13:05:48.220050 6988 leader_election.cc:302] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5948c46c0fd74faba47a1fe9123796d6, d7b53bfa2e0040078da36b426e122abc; no voters:
I20260806 13:05:48.220201 7388 raft_consensus.cc:2781] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:48.220449 7388 raft_consensus.cc:686] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 1 LEADER]: Becoming Leader. State: Replica: 5948c46c0fd74faba47a1fe9123796d6, State: Running, Role: LEADER
I20260806 13:05:48.220602 7388 consensus_queue.cc:237] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } }
I20260806 13:05:48.221762 6911 catalog_manager.cc:5495] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5948c46c0fd74faba47a1fe9123796d6 (127.20.245.129). New cstate: current_term: 1 leader_uuid: "5948c46c0fd74faba47a1fe9123796d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5948c46c0fd74faba47a1fe9123796d6" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 36079 } health_report { overall_health: HEALTHY } } }
W20260806 13:05:48.257134 7369 tablet.cc:2369] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:48.268985 7381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.265899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42860 (local address 127.20.245.129:36079)
0806 13:05:48.265982 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:48.265984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:48.265999 (+ 15us) server_negotiation.cc:407] Connection header received
0806 13:05:48.266051 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:48.266052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:48.266112 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:48.266214 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:05:48.266397 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.266985 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.267980 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:48.268228 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:48.268318 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:48.268520 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:05:48.268665 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:05:48.268783 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:48.268803 (+ 20us) server_negotiation.cc:299] Negotiation successful
0806 13:05:48.268834 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 13:05:48.271667 7322 raft_consensus.cc:1261] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 1 FOLLOWER]: Refusing update from remote peer 5948c46c0fd74faba47a1fe9123796d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:48.271667 7189 raft_consensus.cc:1261] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 1 FOLLOWER]: Refusing update from remote peer 5948c46c0fd74faba47a1fe9123796d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:48.272132 7388 consensus_queue.cc:1035] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "208de0dff3474bafb4309fe6d3704d78" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:48.272333 7392 consensus_queue.cc:1035] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b53bfa2e0040078da36b426e122abc" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 35309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:48.276180 7398 mvcc.cc:205] Tried to move back new op lower bound from 7315544261716774912 to 7315544261512454144. Current Snapshot: MvccSnapshot[applied={T|T < 7315544261716774912}]
I20260806 13:05:48.276356 7396 mvcc.cc:205] Tried to move back new op lower bound from 7315544261716774912 to 7315544261512454144. Current Snapshot: MvccSnapshot[applied={T|T < 7315544261716774912 or (T in {7315544261716774912})}]
I20260806 13:05:48.278723 6909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:48.278864 6909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:48.279924 6909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 234da1c5e2064e1da7afc6508b31e030: Sending DeleteTablet for 3 replicas of tablet db9d8896c80f474b88b1dee32467fb5b
I20260806 13:05:48.280355 7302 tablet_service.cc:1514] Processing DeleteTablet for tablet db9d8896c80f474b88b1dee32467fb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:48 UTC) from {username='slave'} at 127.0.0.1:58884
I20260806 13:05:48.280395 7035 tablet_service.cc:1514] Processing DeleteTablet for tablet db9d8896c80f474b88b1dee32467fb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:48 UTC) from {username='slave'} at 127.0.0.1:42852
I20260806 13:05:48.280716 7169 tablet_service.cc:1514] Processing DeleteTablet for tablet db9d8896c80f474b88b1dee32467fb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:48 UTC) from {username='slave'} at 127.0.0.1:54184
I20260806 13:05:48.280884 7406 tablet_replica.cc:330] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6: stopping tablet replica
I20260806 13:05:48.280977 7408 tablet_replica.cc:330] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: stopping tablet replica
I20260806 13:05:48.280999 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 6972
I20260806 13:05:48.281059 7406 raft_consensus.cc:2229] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:05:48.281189 7406 raft_consensus.cc:2258] T db9d8896c80f474b88b1dee32467fb5b P 5948c46c0fd74faba47a1fe9123796d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:48.282084 7408 raft_consensus.cc:2229] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:48.282243 7408 raft_consensus.cc:2258] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:48.282876 7408 ts_tablet_manager.cc:1905] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:48.283870 7407 tablet_replica.cc:330] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: stopping tablet replica
I20260806 13:05:48.284070 7407 raft_consensus.cc:2229] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:48.284237 7407 raft_consensus.cc:2258] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:48.284803 7407 ts_tablet_manager.cc:1905] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:48.285422 7408 ts_tablet_manager.cc:1918] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:48.285529 7408 log.cc:1196] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/db9d8896c80f474b88b1dee32467fb5b
I20260806 13:05:48.285828 7408 ts_tablet_manager.cc:1939] T db9d8896c80f474b88b1dee32467fb5b P d7b53bfa2e0040078da36b426e122abc: Deleting consensus metadata
I20260806 13:05:48.286468 6895 catalog_manager.cc:4841] TS d7b53bfa2e0040078da36b426e122abc (127.20.245.130:35309): tablet db9d8896c80f474b88b1dee32467fb5b (table test-table [id=7f253654421444d5a9e0db1b0157f116]) successfully deleted
I20260806 13:05:48.286644 7407 ts_tablet_manager.cc:1918] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:48.286759 7407 log.cc:1196] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/db9d8896c80f474b88b1dee32467fb5b
I20260806 13:05:48.287009 7407 ts_tablet_manager.cc:1939] T db9d8896c80f474b88b1dee32467fb5b P 208de0dff3474bafb4309fe6d3704d78: Deleting consensus metadata
I20260806 13:05:48.287618 6897 catalog_manager.cc:4841] TS 208de0dff3474bafb4309fe6d3704d78 (127.20.245.131:35557): tablet db9d8896c80f474b88b1dee32467fb5b (table test-table [id=7f253654421444d5a9e0db1b0157f116]) successfully deleted
W20260806 13:05:48.289499 6895 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:36079 (error 108)
I20260806 13:05:48.289896 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 7105
I20260806 13:05:48.290256 7378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:48.290098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:36079 (local address 127.0.0.1:42872)
0806 13:05:48.290159 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:48.290203 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:36079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 13:05:48.290395 6895 catalog_manager.cc:4584] TS 5948c46c0fd74faba47a1fe9123796d6 (127.20.245.129:36079): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet db9d8896c80f474b88b1dee32467fb5b: Network error: Client connection negotiation failed: client connection to 127.20.245.129:36079: connect: Connection refused (error 111)
I20260806 13:05:48.296413 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 7238
I20260806 13:05:48.303308 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 6879
2026-08-06T13:05:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (986 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:05:48 dist-test-slave-srgv krb5kdc[7412](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:05:48 dist-test-slave-srgv krb5kdc[7412](info): set up 2 sockets
Aug 06 13:05:48 dist-test-slave-srgv krb5kdc[7412](info): commencing operation
krb5kdc: starting...
W20260806 13:05:49.388607 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:05:49 dist-test-slave-srgv krb5kdc[7412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:05:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:05:49.538533 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:32769
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:42427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:32769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:49.635401 7425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:49.635687 7425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:49.635716 7425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:49.637215 7425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:49.637287 7425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:49.637303 7425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:49.637317 7425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:49.637331 7425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:49.639245 7425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:42427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:32769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:32769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:49.639607 7425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:49.639923 7425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:49.645982 7430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:49.645998 7431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:49.646001 7433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:49.646479 7425 server_base.cc:1034] running on GCE node
I20260806 13:05:49.646804 7425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:49.647271 7425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:49.648458 7425 hybrid_clock.cc:648] HybridClock initialized: now 1786021549648432 us; error 48 us; skew 500 ppm
Aug 06 13:05:49 dist-test-slave-srgv krb5kdc[7412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021549, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:49.652136 7425 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:05:49.652873 7425 webserver.cc:460] Webserver started at http://127.20.245.190:34783/ using document root <none> and password file <none>
I20260806 13:05:49.653195 7425 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:49.653257 7425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:49.653477 7425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:49.654871 7425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "607bcc3c061b4428ad20e310e16c9a0b"
format_stamp: "Formatted at 2026-08-06 13:05:49 on dist-test-slave-srgv"
server_key: "7faa1c0b8dba893eaab43268cb690bcb"
server_key_iv: "3de02d212bec6b8733c6223657c67824"
server_key_version: "encryptionkey@0"
I20260806 13:05:49.655401 7425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "607bcc3c061b4428ad20e310e16c9a0b"
format_stamp: "Formatted at 2026-08-06 13:05:49 on dist-test-slave-srgv"
server_key: "7faa1c0b8dba893eaab43268cb690bcb"
server_key_iv: "3de02d212bec6b8733c6223657c67824"
server_key_version: "encryptionkey@0"
I20260806 13:05:49.657248 7425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:49.658319 7440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:49.658608 7425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:49.658735 7425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "607bcc3c061b4428ad20e310e16c9a0b"
format_stamp: "Formatted at 2026-08-06 13:05:49 on dist-test-slave-srgv"
server_key: "7faa1c0b8dba893eaab43268cb690bcb"
server_key_iv: "3de02d212bec6b8733c6223657c67824"
server_key_version: "encryptionkey@0"
I20260806 13:05:49.658807 7425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:49.678025 7425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:49.681196 7425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:49.681365 7425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:49.687021 7425 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:32769
I20260806 13:05:49.687062 7494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:32769 every 8 connection(s)
I20260806 13:05:49.687673 7425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:49.689029 7495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:49.692281 7495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b: Bootstrap starting.
I20260806 13:05:49.693104 7495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:49.693481 7495 log.cc:824] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:49.694614 7495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b: No bootstrap required, opened a new log
I20260806 13:05:49.696194 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 7425
I20260806 13:05:49.696347 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:49.696610 21462 external_mini_cluster.cc:1428] Setting key 55803621a790a314809e1842e14321e1
I20260806 13:05:49.696940 7495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607bcc3c061b4428ad20e310e16c9a0b" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 32769 } }
I20260806 13:05:49.697186 7495 raft_consensus.cc:374] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:49.697237 7495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 607bcc3c061b4428ad20e310e16c9a0b, State: Initialized, Role: FOLLOWER
I20260806 13:05:49.697440 7495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607bcc3c061b4428ad20e310e16c9a0b" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 32769 } }
I20260806 13:05:49.697556 7495 raft_consensus.cc:388] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:49.697615 7495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:49.697670 7495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:49.699018 7495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607bcc3c061b4428ad20e310e16c9a0b" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 32769 } }
I20260806 13:05:49.699148 7495 leader_election.cc:302] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 607bcc3c061b4428ad20e310e16c9a0b; no voters:
I20260806 13:05:49.699352 7495 leader_election.cc:288] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:49.699470 7500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:49.699677 7495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:49.699785 7500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [term 1 LEADER]: Becoming Leader. State: Replica: 607bcc3c061b4428ad20e310e16c9a0b, State: Running, Role: LEADER
I20260806 13:05:49.699970 7500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607bcc3c061b4428ad20e310e16c9a0b" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 32769 } }
I20260806 13:05:49.700484 7502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 607bcc3c061b4428ad20e310e16c9a0b. Latest consensus state: current_term: 1 leader_uuid: "607bcc3c061b4428ad20e310e16c9a0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607bcc3c061b4428ad20e310e16c9a0b" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 32769 } } }
I20260806 13:05:49.700479 7501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "607bcc3c061b4428ad20e310e16c9a0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607bcc3c061b4428ad20e310e16c9a0b" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 32769 } } }
I20260806 13:05:49.700632 7502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:49.700637 7501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:49.700995 7509 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:49.701854 7509 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:49.704191 7509 catalog_manager.cc:1347] Generated new cluster ID: 0c2e4d2ae4c94d7eae4d16deb3c863ca
I20260806 13:05:49.704254 7509 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:05:49 dist-test-slave-srgv krb5kdc[7412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:49.710531 7499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:49.697440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59904 (local address 127.20.245.190:32769)
0806 13:05:49.697721 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:49.697733 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:49.697772 (+ 39us) server_negotiation.cc:407] Connection header received
0806 13:05:49.697927 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:49.697936 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:49.698001 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:49.698187 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:49.698959 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:49.700501 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:49.701805 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:49.702505 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:49.702665 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:49.706144 (+ 3479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:49.706149 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:49.706150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:49.706167 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:49.708448 (+ 2281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:49.709008 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:49.709012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:49.709012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:49.709154 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:49.709398 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:49.709399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:49.709399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:49.709752 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:49.709924 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:49.710104 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 13:05:49.710270 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":184,"threads_started":1}
I20260806 13:05:49.712663 7509 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:49.713235 7509 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:49.723656 7509 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b: Generated new TSK 0
I20260806 13:05:49.723982 7509 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:05:49.764624 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:32769
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:42427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:49.866703 7522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:49.867044 7522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:49.867105 7522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:49.868588 7522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:49.868669 7522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:49.868726 7522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:05:49.870440 7522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:42427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:32769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:49.870780 7522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:49.871089 7522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:49.877215 7528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:49.877269 7527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:49.877215 7530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:49.877727 7522 server_base.cc:1034] running on GCE node
I20260806 13:05:49.878028 7522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:49.878331 7522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:49.879508 7522 hybrid_clock.cc:648] HybridClock initialized: now 1786021549879512 us; error 49 us; skew 500 ppm
Aug 06 13:05:49 dist-test-slave-srgv krb5kdc[7412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021549, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:49.882603 7522 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:05:49.883226 7522 webserver.cc:460] Webserver started at http://127.20.245.129:41829/ using document root <none> and password file <none>
I20260806 13:05:49.883489 7522 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:49.883535 7522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:49.883654 7522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:49.884936 7522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "451c8cfb3e534daea84ad6b96c1d53dc"
format_stamp: "Formatted at 2026-08-06 13:05:49 on dist-test-slave-srgv"
server_key: "8f4b404b57cfe89e4f0338d4f995e965"
server_key_iv: "cfc6f22b75d3c42a329b07667c301536"
server_key_version: "encryptionkey@0"
I20260806 13:05:49.885282 7522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "451c8cfb3e534daea84ad6b96c1d53dc"
format_stamp: "Formatted at 2026-08-06 13:05:49 on dist-test-slave-srgv"
server_key: "8f4b404b57cfe89e4f0338d4f995e965"
server_key_iv: "cfc6f22b75d3c42a329b07667c301536"
server_key_version: "encryptionkey@0"
I20260806 13:05:49.886832 7522 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 13:05:49.887784 7537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:49.888025 7522 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:05:49.888149 7522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "451c8cfb3e534daea84ad6b96c1d53dc"
format_stamp: "Formatted at 2026-08-06 13:05:49 on dist-test-slave-srgv"
server_key: "8f4b404b57cfe89e4f0338d4f995e965"
server_key_iv: "cfc6f22b75d3c42a329b07667c301536"
server_key_version: "encryptionkey@0"
I20260806 13:05:49.888224 7522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:49.910162 7522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:49.913255 7522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:49.913429 7522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:49.913712 7522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:49.914156 7522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:49.914199 7522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:49.914256 7522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:49.914288 7522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:49.921456 7522 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:32985
I20260806 13:05:49.921582 7652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:32985 every 8 connection(s)
I20260806 13:05:49.922016 7522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:05:49.922428 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 7522
I20260806 13:05:49.922564 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:05:49.922897 21462 external_mini_cluster.cc:1428] Setting key a5616a617de5c2b4652912fed3bfc34f
Aug 06 13:05:49 dist-test-slave-srgv krb5kdc[7412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021549, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
I20260806 13:05:49.936036 7499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:49.923296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:45341 (local address 127.20.245.190:32769)
0806 13:05:49.923370 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:49.923373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:49.923633 (+ 260us) server_negotiation.cc:407] Connection header received
0806 13:05:49.924281 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:49.924283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:49.924298 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:49.924378 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:49.925746 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:49.926357 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:49.927882 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:49.928183 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:49.928321 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:49.931666 (+ 3345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:49.931668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:49.931668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:49.931678 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:49.933608 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:49.934353 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:49.934355 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:49.934355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:49.934432 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:49.934864 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:49.934865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:49.934866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:49.935042 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:49.935118 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:49.935724 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 13:05:49.935937 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 13:05:49.936338 7656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:49.923107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:32769 (local address 127.20.245.129:45341)
0806 13:05:49.923458 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:49.923513 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:49.924129 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:49.924469 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:49.924474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:49.925238 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:49.925569 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:49.925580 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:49.926462 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:49.926464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:49.927780 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:49.927783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:49.928346 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:49.928347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:49.928513 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:49.929284 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:49.929296 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:49.931508 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:49.933738 (+ 2230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:49.933756 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:49.933760 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:49.934215 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:49.934520 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:49.934521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:49.934522 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:49.934745 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:49.935153 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:49.935164 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:49.935459 (+ 295us) client_negotiation.cc:769] Sending connection context
0806 13:05:49.935607 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 13:05:49.935926 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":172,"threads_started":1}
I20260806 13:05:49.937275 7653 heartbeater.cc:347] Connected to a master server at 127.20.245.190:32769
I20260806 13:05:49.937438 7653 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:49.937736 7653 heartbeater.cc:511] Master 127.20.245.190:32769 requested a full tablet report, sending...
I20260806 13:05:49.938589 7457 ts_manager.cc:194] Registered new tserver with Master: 451c8cfb3e534daea84ad6b96c1d53dc (127.20.245.129:32985)
I20260806 13:05:49.939469 7457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:45341
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:05:49.964645 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:32769
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:42427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:50.061769 7659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:50.062114 7659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:50.062152 7659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:50.063817 7659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:50.063889 7659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:50.063923 7659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:05:50.065690 7659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:42427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:32769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:50.065982 7659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:50.066238 7659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:50.072849 7664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:50.072849 7666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:50.072890 7668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:50.073262 7659 server_base.cc:1034] running on GCE node
I20260806 13:05:50.073539 7659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:50.073850 7659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:50.075044 7659 hybrid_clock.cc:648] HybridClock initialized: now 1786021550075026 us; error 48 us; skew 500 ppm
Aug 06 13:05:50 dist-test-slave-srgv krb5kdc[7412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021550, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:50.078644 7659 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:05:50.079344 7659 webserver.cc:460] Webserver started at http://127.20.245.130:36491/ using document root <none> and password file <none>
I20260806 13:05:50.079656 7659 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:50.079730 7659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:50.079900 7659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:50.081225 7659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "7ffe06beaa0146b3b59256e4ea67b7ef"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "538e86a2c4d55511f56808ffee7cae4f"
server_key_iv: "fc5c0a408a9c861a5a658c138bed7cd2"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.081660 7659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "7ffe06beaa0146b3b59256e4ea67b7ef"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "538e86a2c4d55511f56808ffee7cae4f"
server_key_iv: "fc5c0a408a9c861a5a658c138bed7cd2"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.083272 7659 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260806 13:05:50.084271 7675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.084550 7659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:50.084681 7659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "7ffe06beaa0146b3b59256e4ea67b7ef"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "538e86a2c4d55511f56808ffee7cae4f"
server_key_iv: "fc5c0a408a9c861a5a658c138bed7cd2"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.084780 7659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:50.099136 7659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:50.109277 7659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:50.109529 7659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:50.109863 7659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:50.110266 7659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:50.110323 7659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.110370 7659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:50.110411 7659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.117619 7659 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:33219
I20260806 13:05:50.117688 7788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:33219 every 8 connection(s)
I20260806 13:05:50.118145 7659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:05:50.122159 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 7659
I20260806 13:05:50.122314 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:05:50.122570 21462 external_mini_cluster.cc:1428] Setting key 79a4ac88eeff7f3bdf4222d5c4568465
Aug 06 13:05:50 dist-test-slave-srgv krb5kdc[7412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021550, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:50.131026 7499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.119256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:43637 (local address 127.20.245.190:32769)
0806 13:05:50.119345 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.119347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.119604 (+ 257us) server_negotiation.cc:407] Connection header received
0806 13:05:50.120253 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.120255 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.120269 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.120339 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:50.121561 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.122314 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.124018 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.124275 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.124381 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.127686 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:50.127689 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:50.127689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:50.127700 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:50.129420 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:50.129918 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:50.129924 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:50.129925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:50.129983 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:50.130262 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:50.130263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:50.130264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:50.130402 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:50.130483 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.130801 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.130913 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 13:05:50.131356 7791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.119257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:32769 (local address 127.20.245.130:43637)
0806 13:05:50.119442 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.119487 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.120097 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.120439 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.120442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.121149 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:50.121439 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.121444 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.122453 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.122454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.123892 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.123895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.124399 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.124401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.124565 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.125328 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:50.125343 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:50.127545 (+ 2202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:50.129532 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:50.129542 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:50.129545 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:50.129826 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:50.130057 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:50.130058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:50.130059 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:50.130180 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:50.130472 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:50.130479 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:50.130650 (+ 171us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.130769 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.130968 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
I20260806 13:05:50.131943 7789 heartbeater.cc:347] Connected to a master server at 127.20.245.190:32769
I20260806 13:05:50.132092 7789 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:50.132355 7789 heartbeater.cc:511] Master 127.20.245.190:32769 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
I20260806 13:05:50.132845 7457 ts_manager.cc:194] Registered new tserver with Master: 7ffe06beaa0146b3b59256e4ea67b7ef (127.20.245.130:33219)
I20260806 13:05:50.133261 7457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:43637
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:05:50.155491 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:32769
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:42427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:50.260967 7794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:50.261297 7794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:50.261330 7794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:50.262915 7794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:50.263005 7794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:50.263042 7794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:05:50.264966 7794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:42427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:32769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:50.265339 7794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:50.265678 7794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:50.271957 7800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:50.271957 7799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:50.271957 7802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:50.272456 7794 server_base.cc:1034] running on GCE node
I20260806 13:05:50.272728 7794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:50.273067 7794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:50.274259 7794 hybrid_clock.cc:648] HybridClock initialized: now 1786021550274258 us; error 74 us; skew 500 ppm
Aug 06 13:05:50 dist-test-slave-srgv krb5kdc[7412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021550, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:50.277642 7794 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:05:50.278249 7794 webserver.cc:460] Webserver started at http://127.20.245.131:43203/ using document root <none> and password file <none>
I20260806 13:05:50.278537 7794 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:50.278615 7794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:50.278791 7794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:50.280149 7794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "2510e359a66149edb800c9d475c1180a"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "2edcfdf02c5d501d49c98e775a8058c1"
server_key_iv: "cb88c537d4b2873127403860b83d2e47"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.280599 7794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "2510e359a66149edb800c9d475c1180a"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "2edcfdf02c5d501d49c98e775a8058c1"
server_key_iv: "cb88c537d4b2873127403860b83d2e47"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.282271 7794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 13:05:50.283298 7810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.283528 7794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:50.283648 7794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "2510e359a66149edb800c9d475c1180a"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "2edcfdf02c5d501d49c98e775a8058c1"
server_key_iv: "cb88c537d4b2873127403860b83d2e47"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.283737 7794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:50.297540 7794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:50.300776 7794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:50.300976 7794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:50.301303 7794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:50.301764 7794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:50.301823 7794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.301875 7794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:50.301901 7794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.308915 7794 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:44419
I20260806 13:05:50.309002 7926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:44419 every 8 connection(s)
I20260806 13:05:50.309415 7794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:05:50.313325 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 7794
I20260806 13:05:50.313459 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:05:50.313701 21462 external_mini_cluster.cc:1428] Setting key 04f6d7da06777a3763e3a45d70aa72eb
Aug 06 13:05:50 dist-test-slave-srgv krb5kdc[7412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021550, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:50.321163 7499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.310362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:59167 (local address 127.20.245.190:32769)
0806 13:05:50.310464 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.310467 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.310672 (+ 205us) server_negotiation.cc:407] Connection header received
0806 13:05:50.311423 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.311425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.311440 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.311508 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:50.312692 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.313399 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.315292 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.315499 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.315562 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.318236 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:50.318238 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:50.318239 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:50.318248 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:50.319781 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:50.320186 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:50.320186 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:50.320187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:50.320242 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:50.320526 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:50.320526 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:50.320527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:50.320647 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:50.320703 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.321008 (+ 305us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.321083 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 13:05:50.321491 7929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.310291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:32769 (local address 127.20.245.131:59167)
0806 13:05:50.310513 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.310573 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.311280 (+ 707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.311595 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.311600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.312306 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:50.312551 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.312556 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.313549 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.313550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.315139 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.315143 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.315596 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.315597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.315759 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.316418 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:50.316428 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:50.318123 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:50.319858 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:50.319865 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:50.319867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:50.320114 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:50.320332 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:50.320333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:50.320334 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:50.320454 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:50.320717 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:50.320723 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:50.320882 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.320979 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.321149 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":100,"threads_started":1}
I20260806 13:05:50.322180 7927 heartbeater.cc:347] Connected to a master server at 127.20.245.190:32769
I20260806 13:05:50.322324 7927 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:50.322526 7927 heartbeater.cc:511] Master 127.20.245.190:32769 requested a full tablet report, sending...
I20260806 13:05:50.322969 7457 ts_manager.cc:194] Registered new tserver with Master: 2510e359a66149edb800c9d475c1180a (127.20.245.131:44419)
I20260806 13:05:50.323459 7457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:59167
I20260806 13:05:50.326272 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:05:50.335858 7499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.328046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45192 (local address 127.20.245.190:32769)
0806 13:05:50.328156 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.328160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.328304 (+ 144us) server_negotiation.cc:407] Connection header received
0806 13:05:50.328394 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.328396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.328408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.328485 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:50.329161 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.329729 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.330501 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.330718 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.330803 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.332862 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:50.332863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:50.332864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:50.332872 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:50.334449 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:50.334901 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:50.334902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:50.334902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:50.334961 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:50.335161 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:50.335162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:50.335162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:50.335385 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:50.335498 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.335624 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.335678 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 13:05:50.338013 7457 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:05:50.340270 7457 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:05:50.348227 7938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.343422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:33219 (local address 127.0.0.1:32974)
0806 13:05:50.343722 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.343735 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.343951 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.344282 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.344286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.344289 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:50.344392 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.344394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.345807 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.345808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.346754 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.346756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.347806 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.347807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.347906 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.347922 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.348001 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.348111 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":94,"thread_start_us":110,"threads_started":1}
I20260806 13:05:50.348443 7943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.344058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52210 (local address 127.20.245.129:32985)
0806 13:05:50.344398 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.344403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.344413 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:05:50.344460 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.344462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.344480 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.344572 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:50.344690 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.345764 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.347139 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.347714 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.347815 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.347877 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.348279 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.348340 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":114,"threads_started":1}
I20260806 13:05:50.348623 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.343745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32974 (local address 127.20.245.130:33219)
0806 13:05:50.343960 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.343966 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.343982 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:05:50.344038 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.344041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.344059 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.344150 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:50.344493 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.345681 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.346856 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.347699 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.347793 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.347873 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.348044 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.348096 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":135,"threads_started":1}
I20260806 13:05:50.348729 7940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.343470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57558 (local address 127.20.245.131:44419)
0806 13:05:50.344125 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.344130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.344141 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:05:50.344189 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.344191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.344209 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.344322 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:50.344455 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.345335 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.346997 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.347719 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.348267 (+ 548us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.348468 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.348563 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.348623 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":132,"threads_started":1}
I20260806 13:05:50.349143 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.343603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:32985 (local address 127.0.0.1:52210)
0806 13:05:50.343880 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.343889 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.344206 (+ 317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.344588 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.344589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.344591 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:50.344629 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.344630 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.345857 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.345858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.347045 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.347052 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.348032 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.348033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.348110 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.348112 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.348160 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.348198 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":98,"threads_started":1}
I20260806 13:05:50.348201 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.343318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:44419 (local address 127.0.0.1:57558)
0806 13:05:50.343598 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.343651 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.343773 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.344322 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.344323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.344325 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:50.344392 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.344393 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.345452 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.345453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.346894 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.346897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.347815 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.347817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.347917 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.347924 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.347971 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.348090 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":39,"thread_start_us":87,"threads_started":1}
I20260806 13:05:50.349790 7723 tablet_service.cc:1467] Processing CreateTablet for tablet 0e0a74f7e14f40c9a62a7327bf29958d (DEFAULT_TABLE table=test-table [id=84199a109e0444068ec073fd46ef385f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:50.349938 7859 tablet_service.cc:1467] Processing CreateTablet for tablet 0e0a74f7e14f40c9a62a7327bf29958d (DEFAULT_TABLE table=test-table [id=84199a109e0444068ec073fd46ef385f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:50.349977 7586 tablet_service.cc:1467] Processing CreateTablet for tablet 0e0a74f7e14f40c9a62a7327bf29958d (DEFAULT_TABLE table=test-table [id=84199a109e0444068ec073fd46ef385f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:50.350322 7859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e0a74f7e14f40c9a62a7327bf29958d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:50.350322 7723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e0a74f7e14f40c9a62a7327bf29958d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:50.350322 7586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e0a74f7e14f40c9a62a7327bf29958d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:50.353673 7944 tablet_bootstrap.cc:492] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: Bootstrap starting.
I20260806 13:05:50.354197 7946 tablet_bootstrap.cc:492] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Bootstrap starting.
I20260806 13:05:50.354617 7944 tablet_bootstrap.cc:654] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:50.354853 7946 tablet_bootstrap.cc:654] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:50.355365 7944 log.cc:824] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:50.355389 7945 tablet_bootstrap.cc:492] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc: Bootstrap starting.
I20260806 13:05:50.355566 7946 log.cc:824] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:50.356178 7945 tablet_bootstrap.cc:654] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:50.356418 7946 tablet_bootstrap.cc:492] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: No bootstrap required, opened a new log
I20260806 13:05:50.356412 7944 tablet_bootstrap.cc:492] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: No bootstrap required, opened a new log
I20260806 13:05:50.356503 7946 ts_tablet_manager.cc:1397] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 13:05:50.356503 7944 ts_tablet_manager.cc:1397] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:05:50.356823 7945 log.cc:824] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:50.357694 7945 tablet_bootstrap.cc:492] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc: No bootstrap required, opened a new log
I20260806 13:05:50.357772 7945 ts_tablet_manager.cc:1397] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:50.358484 7946 raft_consensus.cc:348] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.358686 7946 raft_consensus.cc:374] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:50.358734 7946 raft_consensus.cc:729] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffe06beaa0146b3b59256e4ea67b7ef, State: Initialized, Role: FOLLOWER
I20260806 13:05:50.358904 7946 consensus_queue.cc:260] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.358829 7944 raft_consensus.cc:348] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.359010 7944 raft_consensus.cc:374] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:50.359055 7944 raft_consensus.cc:729] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2510e359a66149edb800c9d475c1180a, State: Initialized, Role: FOLLOWER
I20260806 13:05:50.359239 7944 consensus_queue.cc:260] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.359289 7946 ts_tablet_manager.cc:1428] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 13:05:50.359434 7789 heartbeater.cc:503] Master 127.20.245.190:32769 was elected leader, sending a full tablet report...
I20260806 13:05:50.359543 7944 ts_tablet_manager.cc:1428] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 13:05:50.359664 7927 heartbeater.cc:503] Master 127.20.245.190:32769 was elected leader, sending a full tablet report...
I20260806 13:05:50.360666 7945 raft_consensus.cc:348] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.360827 7945 raft_consensus.cc:374] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:50.360852 7945 raft_consensus.cc:729] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c8cfb3e534daea84ad6b96c1d53dc, State: Initialized, Role: FOLLOWER
I20260806 13:05:50.361022 7945 consensus_queue.cc:260] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.361341 7945 ts_tablet_manager.cc:1428] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260806 13:05:50.361399 7653 heartbeater.cc:503] Master 127.20.245.190:32769 was elected leader, sending a full tablet report...
W20260806 13:05:50.368886 7790 tablet.cc:2369] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:50.385365 7952 raft_consensus.cc:482] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:50.385625 7952 raft_consensus.cc:504] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.386234 7952 leader_election.cc:288] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2510e359a66149edb800c9d475c1180a (127.20.245.131:44419), 7ffe06beaa0146b3b59256e4ea67b7ef (127.20.245.130:33219)
I20260806 13:05:50.390233 7656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.386436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:44419 (local address 127.20.245.129:47183)
0806 13:05:50.386516 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.386531 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.386611 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.387014 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.387015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.387018 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:50.387141 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.387144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.388249 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.388250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.389254 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.389257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.389926 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.389927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.390011 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.390015 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.390095 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.390142 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 13:05:50.390233 7940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.386800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:47183 (local address 127.20.245.131:44419)
0806 13:05:50.386856 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.386858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.386867 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:05:50.386901 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.386902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.386913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.386973 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:50.387370 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.388142 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.389351 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.389859 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.389932 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.389946 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.390104 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.390153 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 13:05:50.390661 7879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e0a74f7e14f40c9a62a7327bf29958d" candidate_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2510e359a66149edb800c9d475c1180a" is_pre_election: true
I20260806 13:05:50.390872 7879 raft_consensus.cc:2454] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c8cfb3e534daea84ad6b96c1d53dc in term 0.
I20260806 13:05:50.391230 7539 leader_election.cc:302] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2510e359a66149edb800c9d475c1180a, 451c8cfb3e534daea84ad6b96c1d53dc; no voters:
I20260806 13:05:50.391494 7952 raft_consensus.cc:2781] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:05:50.391582 7952 raft_consensus.cc:482] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:05:50.391625 7952 raft_consensus.cc:3037] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:50.391651 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.386575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:33263 (local address 127.20.245.130:33219)
0806 13:05:50.386665 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.386667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.386817 (+ 150us) server_negotiation.cc:407] Connection header received
0806 13:05:50.386902 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.386903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.386917 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.386973 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:50.387257 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.388143 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.390499 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.391121 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.391242 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.391253 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.391502 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.391555 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 13:05:50.391819 7953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.386437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:33219 (local address 127.20.245.129:33263)
0806 13:05:50.386724 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.386735 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.386810 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.387038 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.387039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.387041 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:50.387130 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.387132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.389347 (+ 2215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.389348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.390410 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.390414 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.391271 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.391272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.391357 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.391363 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.391466 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.391553 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":24,"thread_start_us":171,"threads_started":1}
I20260806 13:05:50.392200 7743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e0a74f7e14f40c9a62a7327bf29958d" candidate_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" is_pre_election: true
I20260806 13:05:50.392413 7743 raft_consensus.cc:2454] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c8cfb3e534daea84ad6b96c1d53dc in term 0.
I20260806 13:05:50.392877 7952 raft_consensus.cc:504] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.393042 7952 leader_election.cc:288] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [CANDIDATE]: Term 1 election: Requested vote from peers 2510e359a66149edb800c9d475c1180a (127.20.245.131:44419), 7ffe06beaa0146b3b59256e4ea67b7ef (127.20.245.130:33219)
I20260806 13:05:50.393198 7879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e0a74f7e14f40c9a62a7327bf29958d" candidate_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2510e359a66149edb800c9d475c1180a"
I20260806 13:05:50.393226 7743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e0a74f7e14f40c9a62a7327bf29958d" candidate_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef"
I20260806 13:05:50.393313 7879 raft_consensus.cc:3037] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:50.393321 7743 raft_consensus.cc:3037] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:50.394251 7879 raft_consensus.cc:2454] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c8cfb3e534daea84ad6b96c1d53dc in term 1.
I20260806 13:05:50.394253 7743 raft_consensus.cc:2454] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c8cfb3e534daea84ad6b96c1d53dc in term 1.
I20260806 13:05:50.394480 7538 leader_election.cc:302] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c8cfb3e534daea84ad6b96c1d53dc, 7ffe06beaa0146b3b59256e4ea67b7ef; no voters:
I20260806 13:05:50.394595 7952 raft_consensus.cc:2781] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:50.394748 7952 raft_consensus.cc:686] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [term 1 LEADER]: Becoming Leader. State: Replica: 451c8cfb3e534daea84ad6b96c1d53dc, State: Running, Role: LEADER
I20260806 13:05:50.394877 7952 consensus_queue.cc:237] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } }
I20260806 13:05:50.396170 7456 catalog_manager.cc:5495] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c8cfb3e534daea84ad6b96c1d53dc (127.20.245.129). New cstate: current_term: 1 leader_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c8cfb3e534daea84ad6b96c1d53dc" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260806 13:05:50.408812 7943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.405033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52224 (local address 127.20.245.129:32985)
0806 13:05:50.405118 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.405121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.405132 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:05:50.405194 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.405195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.405217 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.405292 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:05:50.405438 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.405987 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.407485 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.407895 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.407984 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.408215 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:05:50.408383 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:05:50.408512 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.408607 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.408627 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 13:05:50.412166 7879 raft_consensus.cc:1261] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 1 FOLLOWER]: Refusing update from remote peer 451c8cfb3e534daea84ad6b96c1d53dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:50.412204 7743 raft_consensus.cc:1261] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 1 FOLLOWER]: Refusing update from remote peer 451c8cfb3e534daea84ad6b96c1d53dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:50.412688 7952 consensus_queue.cc:1035] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2510e359a66149edb800c9d475c1180a" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:50.413098 7954 consensus_queue.cc:1035] T 0e0a74f7e14f40c9a62a7327bf29958d P 451c8cfb3e534daea84ad6b96c1d53dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffe06beaa0146b3b59256e4ea67b7ef" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:50.417260 7958 mvcc.cc:205] Tried to move back new op lower bound from 7315544270484254720 to 7315544270418530304. Current Snapshot: MvccSnapshot[applied={T|T < 7315544270484254720 or (T in {7315544270484254720})}]
I20260806 13:05:50.417418 7959 mvcc.cc:205] Tried to move back new op lower bound from 7315544270484254720 to 7315544270418530304. Current Snapshot: MvccSnapshot[applied={T|T < 7315544270484254720}]
I20260806 13:05:50.419440 7456 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:50.419588 7456 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:50.420725 7456 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 607bcc3c061b4428ad20e310e16c9a0b: Sending DeleteTablet for 3 replicas of tablet 0e0a74f7e14f40c9a62a7327bf29958d
I20260806 13:05:50.421167 7723 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e0a74f7e14f40c9a62a7327bf29958d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:50 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:32974
I20260806 13:05:50.421195 7586 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e0a74f7e14f40c9a62a7327bf29958d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:50 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:52210
I20260806 13:05:50.421247 7859 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e0a74f7e14f40c9a62a7327bf29958d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:50 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:57558
I20260806 13:05:50.421815 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 7522
I20260806 13:05:50.423360 7969 tablet_replica.cc:330] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: stopping tablet replica
I20260806 13:05:50.423532 7969 raft_consensus.cc:2229] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:50.423702 7969 raft_consensus.cc:2258] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:50.424335 7969 ts_tablet_manager.cc:1905] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:50.424602 7967 tablet_replica.cc:330] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: stopping tablet replica
I20260806 13:05:50.424753 7967 raft_consensus.cc:2229] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:50.424875 7967 raft_consensus.cc:2258] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:50.425401 7967 ts_tablet_manager.cc:1905] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:50.426622 7969 ts_tablet_manager.cc:1918] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:50.426733 7969 log.cc:1196] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/0e0a74f7e14f40c9a62a7327bf29958d
I20260806 13:05:50.427066 7969 ts_tablet_manager.cc:1939] T 0e0a74f7e14f40c9a62a7327bf29958d P 2510e359a66149edb800c9d475c1180a: Deleting consensus metadata
I20260806 13:05:50.427680 7967 ts_tablet_manager.cc:1918] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:50.427770 7967 log.cc:1196] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/0e0a74f7e14f40c9a62a7327bf29958d
I20260806 13:05:50.427706 7442 catalog_manager.cc:4841] TS 2510e359a66149edb800c9d475c1180a (127.20.245.131:44419): tablet 0e0a74f7e14f40c9a62a7327bf29958d (table test-table [id=84199a109e0444068ec073fd46ef385f]) successfully deleted
I20260806 13:05:50.428056 7967 ts_tablet_manager.cc:1939] T 0e0a74f7e14f40c9a62a7327bf29958d P 7ffe06beaa0146b3b59256e4ea67b7ef: Deleting consensus metadata
I20260806 13:05:50.428646 7441 catalog_manager.cc:4841] TS 7ffe06beaa0146b3b59256e4ea67b7ef (127.20.245.130:33219): tablet 0e0a74f7e14f40c9a62a7327bf29958d (table test-table [id=84199a109e0444068ec073fd46ef385f]) successfully deleted
W20260806 13:05:50.429914 7442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:32985 (error 108)
I20260806 13:05:50.430248 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 7659
I20260806 13:05:50.431478 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.430433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:32985 (local address 127.0.0.1:52236)
0806 13:05:50.431360 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.431421 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:32985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":894}
W20260806 13:05:50.431684 7442 catalog_manager.cc:4584] TS 451c8cfb3e534daea84ad6b96c1d53dc (127.20.245.129:32985): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0e0a74f7e14f40c9a62a7327bf29958d: Network error: Client connection negotiation failed: client connection to 127.20.245.129:32985: connect: Connection refused (error 111)
I20260806 13:05:50.438465 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 7794
I20260806 13:05:50.445201 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 7425
2026-08-06T13:05:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2142 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T13:05:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:50Z Disabled control of system clock
I20260806 13:05:50.479974 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36055
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:42387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:36055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 13:05:50.577011 7974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:50.577283 7974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:50.577308 7974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:50.578675 7974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:50.578723 7974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:50.578737 7974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:50.578750 7974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:50.578763 7974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:50.581247 7974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:42387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:36055
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:36055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:50.581645 7974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:50.582094 7974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:50.588762 7983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:50.588749 7980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:50.588750 7981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:50.589521 7974 server_base.cc:1034] running on GCE node
I20260806 13:05:50.589835 7974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:50.590173 7974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:50.591359 7974 hybrid_clock.cc:648] HybridClock initialized: now 1786021550591329 us; error 42 us; skew 500 ppm
I20260806 13:05:50.593082 7974 webserver.cc:460] Webserver started at http://127.20.245.190:41223/ using document root <none> and password file <none>
I20260806 13:05:50.593482 7974 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:50.593570 7974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:50.593765 7974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:50.595247 7974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "f981b251b0694440a6428138dce55796"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "bd2009e91a7913b9a379e770aed3c810"
server_key_iv: "d693c62cf9c1033d99f80b53dd44330e"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.595772 7974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "f981b251b0694440a6428138dce55796"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "bd2009e91a7913b9a379e770aed3c810"
server_key_iv: "d693c62cf9c1033d99f80b53dd44330e"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.597496 7974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:05:50.598534 7989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.598732 7974 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:50.598860 7974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "f981b251b0694440a6428138dce55796"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "bd2009e91a7913b9a379e770aed3c810"
server_key_iv: "d693c62cf9c1033d99f80b53dd44330e"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.598955 7974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:50.618458 7974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:50.619009 7974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:50.619321 7974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:50.625138 7974 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:36055
I20260806 13:05:50.625190 8041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:36055 every 8 connection(s)
I20260806 13:05:50.625679 7974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:50.626271 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 7974
I20260806 13:05:50.626442 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:50.626713 21462 external_mini_cluster.cc:1428] Setting key 970a23c3305339938953cd5a84f9e23a
I20260806 13:05:50.627317 8042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:50.631683 8042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796: Bootstrap starting.
I20260806 13:05:50.632920 8042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:50.633361 8042 log.cc:824] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:50.634267 8042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796: No bootstrap required, opened a new log
I20260806 13:05:50.634781 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.627521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48558 (local address 127.20.245.190:36055)
0806 13:05:50.627775 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.627784 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.627816 (+ 32us) server_negotiation.cc:407] Connection header received
0806 13:05:50.628413 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.628421 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.628502 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.628655 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:50.628994 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.630116 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.631452 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.632187 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.632459 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.633751 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:50.633757 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:50.633757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:50.633981 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:50.634023 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:50.634037 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:50.634124 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.634304 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.634417 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":118,"threads_started":1}
I20260806 13:05:50.636894 8042 raft_consensus.cc:348] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f981b251b0694440a6428138dce55796" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36055 } }
I20260806 13:05:50.637075 8042 raft_consensus.cc:374] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:50.637102 8042 raft_consensus.cc:729] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f981b251b0694440a6428138dce55796, State: Initialized, Role: FOLLOWER
I20260806 13:05:50.637207 8042 consensus_queue.cc:260] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f981b251b0694440a6428138dce55796" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36055 } }
I20260806 13:05:50.637269 8042 raft_consensus.cc:388] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:50.637303 8042 raft_consensus.cc:482] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:50.637341 8042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:50.638062 8042 raft_consensus.cc:504] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f981b251b0694440a6428138dce55796" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36055 } }
I20260806 13:05:50.638170 8042 leader_election.cc:302] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f981b251b0694440a6428138dce55796; no voters:
I20260806 13:05:50.638360 8042 leader_election.cc:288] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:50.638509 8047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:50.638700 8047 raft_consensus.cc:686] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [term 1 LEADER]: Becoming Leader. State: Replica: f981b251b0694440a6428138dce55796, State: Running, Role: LEADER
I20260806 13:05:50.638811 8047 consensus_queue.cc:237] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f981b251b0694440a6428138dce55796" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36055 } }
I20260806 13:05:50.638834 8042 sys_catalog.cc:564] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:50.639353 8048 sys_catalog.cc:455] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f981b251b0694440a6428138dce55796" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f981b251b0694440a6428138dce55796" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36055 } } }
I20260806 13:05:50.639488 8048 sys_catalog.cc:458] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:50.639379 8049 sys_catalog.cc:455] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f981b251b0694440a6428138dce55796. Latest consensus state: current_term: 1 leader_uuid: "f981b251b0694440a6428138dce55796" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f981b251b0694440a6428138dce55796" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 36055 } } }
I20260806 13:05:50.639598 8049 sys_catalog.cc:458] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:50.640050 8057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:50.640604 8057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:50.642668 8057 catalog_manager.cc:1347] Generated new cluster ID: 6af6f5f2552d489290b2d1d51cd62131
I20260806 13:05:50.642743 8057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:05:50.655452 8057 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:50.656107 8057 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:50.661705 8057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796: Generated new TSK 0
I20260806 13:05:50.661970 8057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:05:50.670325 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36055
--builtin_ntp_servers=127.20.245.148:42387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 13:05:50.787655 8067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:50.787977 8067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:50.788028 8067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:50.789513 8067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:50.789594 8067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:50.789675 8067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:05:50.791851 8067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:42387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:50.792848 8067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:50.793921 8067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:50.800995 8076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:50.801015 8073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:50.801400 8067 server_base.cc:1034] running on GCE node
W20260806 13:05:50.800995 8074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:50.801774 8067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:50.802115 8067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:50.803273 8067 hybrid_clock.cc:648] HybridClock initialized: now 1786021550803259 us; error 32 us; skew 500 ppm
I20260806 13:05:50.805071 8067 webserver.cc:460] Webserver started at http://127.20.245.129:36983/ using document root <none> and password file <none>
I20260806 13:05:50.805398 8067 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:50.805482 8067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:50.805661 8067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:50.807046 8067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "bbe26b895ed24f789e9ac53cf78b7c7f"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "5f8b25d68377b5c2ef6eebe241bd6a21"
server_key_iv: "e2e68f16e92fc0bd98ef0c70fee34f40"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.807597 8067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "bbe26b895ed24f789e9ac53cf78b7c7f"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "5f8b25d68377b5c2ef6eebe241bd6a21"
server_key_iv: "e2e68f16e92fc0bd98ef0c70fee34f40"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.809180 8067 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:05:50.810266 8082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.810544 8067 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:50.810670 8067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "bbe26b895ed24f789e9ac53cf78b7c7f"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "5f8b25d68377b5c2ef6eebe241bd6a21"
server_key_iv: "e2e68f16e92fc0bd98ef0c70fee34f40"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.810801 8067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:50.822925 8067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:50.823540 8067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:50.823741 8067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:50.824082 8067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:50.824556 8067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:50.824620 8067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.824666 8067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:50.824709 8067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.832211 8067 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:34091
I20260806 13:05:50.832260 8198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:34091 every 8 connection(s)
I20260806 13:05:50.832729 8067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:05:50.838212 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 8067
I20260806 13:05:50.838367 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:05:50.838639 21462 external_mini_cluster.cc:1428] Setting key 75a10ffca95d9fe8c544c1c86b97400b
I20260806 13:05:50.839367 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.833737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:40647 (local address 127.20.245.190:36055)
0806 13:05:50.833844 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.833848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.834102 (+ 254us) server_negotiation.cc:407] Connection header received
0806 13:05:50.834734 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.834735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.834755 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.834830 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:50.835699 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.836321 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.837361 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.837552 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.837606 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.838916 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:50.838918 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:50.838919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:50.838926 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:50.838947 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:50.838953 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:50.839016 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.839202 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.839261 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 13:05:50.839684 8201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.833694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36055 (local address 127.20.245.129:40647)
0806 13:05:50.833946 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.833988 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.834626 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.834916 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.834919 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.834931 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:50.835610 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.835615 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.836413 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.836414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.837285 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.837287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.837631 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.837631 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.837774 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.838640 (+ 866us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:50.838641 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:50.838693 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:50.838745 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:50.839029 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:50.839039 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:50.839042 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.839162 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.839388 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":133,"threads_started":1}
I20260806 13:05:50.840035 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36055
--builtin_ntp_servers=127.20.245.148:42387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 13:05:50.840299 8199 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36055
I20260806 13:05:50.840438 8199 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:50.840699 8199 heartbeater.cc:511] Master 127.20.245.190:36055 requested a full tablet report, sending...
I20260806 13:05:50.841500 8006 ts_manager.cc:194] Registered new tserver with Master: bbe26b895ed24f789e9ac53cf78b7c7f (127.20.245.129:34091)
I20260806 13:05:50.842614 8006 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.129:40647
W20260806 13:05:50.935385 8202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:50.935658 8202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:50.935686 8202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:50.936980 8202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:50.937069 8202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:50.937099 8202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:05:50.938647 8202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:42387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:50.938903 8202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:50.939424 8202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:50.945767 8207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:50.946018 8202 server_base.cc:1034] running on GCE node
W20260806 13:05:50.945749 8210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:50.945772 8208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:50.946450 8202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:50.946823 8202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:50.948052 8202 hybrid_clock.cc:648] HybridClock initialized: now 1786021550948043 us; error 56 us; skew 500 ppm
I20260806 13:05:50.949735 8202 webserver.cc:460] Webserver started at http://127.20.245.130:38553/ using document root <none> and password file <none>
I20260806 13:05:50.950052 8202 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:50.950130 8202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:50.950407 8202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:50.951810 8202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "c4e68fba4187456f92056984ae378f27"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "2ed3e70ee030b6bb576502952f20e787"
server_key_iv: "7f156b9152a4aad3be2a7104359bb6a2"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.952242 8202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "c4e68fba4187456f92056984ae378f27"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "2ed3e70ee030b6bb576502952f20e787"
server_key_iv: "7f156b9152a4aad3be2a7104359bb6a2"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.953824 8202 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:05:50.954800 8216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.955058 8202 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:50.955269 8202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "c4e68fba4187456f92056984ae378f27"
format_stamp: "Formatted at 2026-08-06 13:05:50 on dist-test-slave-srgv"
server_key: "2ed3e70ee030b6bb576502952f20e787"
server_key_iv: "7f156b9152a4aad3be2a7104359bb6a2"
server_key_version: "encryptionkey@0"
I20260806 13:05:50.955365 8202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:50.976373 8202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:50.976866 8202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:50.977061 8202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:50.977464 8202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:50.977932 8202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:50.977995 8202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.978047 8202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:50.978087 8202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:50.985885 8202 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:39145
I20260806 13:05:50.985953 8329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:39145 every 8 connection(s)
I20260806 13:05:50.986428 8202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:05:50.987694 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 8202
I20260806 13:05:50.987869 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:05:50.988124 21462 external_mini_cluster.cc:1428] Setting key 04f9cd24ca1a9c917d4f28bf050acdad
I20260806 13:05:50.989526 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36055
--builtin_ntp_servers=127.20.245.148:42387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 13:05:50.994941 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.987786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:40955 (local address 127.20.245.190:36055)
0806 13:05:50.987870 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:50.987873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:50.988278 (+ 405us) server_negotiation.cc:407] Connection header received
0806 13:05:50.989182 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:50.989183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:50.989200 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:50.989278 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:50.990205 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.991046 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.993017 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.993247 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.993319 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.994606 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:50.994608 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:50.994608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:50.994614 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:50.994632 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:50.994637 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:50.994686 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:50.994812 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 13:05:50.994852 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:05:50.995357 8332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:50.987708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36055 (local address 127.20.245.130:40955)
0806 13:05:50.988091 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:50.988137 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:50.989030 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:50.989350 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:50.989354 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:50.989365 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:50.990087 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.990094 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.991307 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.991309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.992901 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:50.992905 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:50.993351 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:50.993352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:50.993557 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:50.994405 (+ 848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:50.994406 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:50.994457 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:50.994497 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:50.994709 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:50.994718 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:50.994723 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:50.994812 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 13:05:50.994969 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":124,"threads_started":1}
I20260806 13:05:50.996109 8330 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36055
I20260806 13:05:50.996271 8330 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:50.996584 8330 heartbeater.cc:511] Master 127.20.245.190:36055 requested a full tablet report, sending...
I20260806 13:05:50.997134 8006 ts_manager.cc:194] Registered new tserver with Master: c4e68fba4187456f92056984ae378f27 (127.20.245.130:39145)
I20260806 13:05:50.997604 8006 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.130:40955
W20260806 13:05:51.090318 8334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:51.090626 8334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:51.090654 8334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:51.092129 8334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:51.092202 8334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:51.092234 8334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:05:51.093845 8334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:42387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:36055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:51.094209 8334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:51.094616 8334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:51.100929 8339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:51.100929 8343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:51.100958 8340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:51.101022 8334 server_base.cc:1034] running on GCE node
I20260806 13:05:51.101416 8334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:51.101745 8334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:51.102950 8334 hybrid_clock.cc:648] HybridClock initialized: now 1786021551102929 us; error 44 us; skew 500 ppm
I20260806 13:05:51.104770 8334 webserver.cc:460] Webserver started at http://127.20.245.131:38553/ using document root <none> and password file <none>
I20260806 13:05:51.105139 8334 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:51.105228 8334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:51.105422 8334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:51.106778 8334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "60b7786a9a284973bc75619aa9fe0d0b"
format_stamp: "Formatted at 2026-08-06 13:05:51 on dist-test-slave-srgv"
server_key: "2e7536525dcb7757a383f3fa22ca7793"
server_key_iv: "6007fefc8fc9ec57a3224245d943e2d5"
server_key_version: "encryptionkey@0"
I20260806 13:05:51.107329 8334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "60b7786a9a284973bc75619aa9fe0d0b"
format_stamp: "Formatted at 2026-08-06 13:05:51 on dist-test-slave-srgv"
server_key: "2e7536525dcb7757a383f3fa22ca7793"
server_key_iv: "6007fefc8fc9ec57a3224245d943e2d5"
server_key_version: "encryptionkey@0"
I20260806 13:05:51.109038 8334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:51.109974 8349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:51.110198 8334 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:51.110321 8334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "60b7786a9a284973bc75619aa9fe0d0b"
format_stamp: "Formatted at 2026-08-06 13:05:51 on dist-test-slave-srgv"
server_key: "2e7536525dcb7757a383f3fa22ca7793"
server_key_iv: "6007fefc8fc9ec57a3224245d943e2d5"
server_key_version: "encryptionkey@0"
I20260806 13:05:51.110412 8334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:51.127285 8334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:51.127767 8334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:51.127954 8334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:51.128275 8334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:51.128708 8334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:51.128768 8334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:51.128813 8334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:51.128842 8334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:51.136261 8334 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:46795
I20260806 13:05:51.136372 8462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:46795 every 8 connection(s)
I20260806 13:05:51.136799 8334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:05:51.138005 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 8334
I20260806 13:05:51.138154 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:05:51.138504 21462 external_mini_cluster.cc:1428] Setting key 045f1c7877e15d7d89a9d9d008e05db9
I20260806 13:05:51.144213 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.137801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:44035 (local address 127.20.245.190:36055)
0806 13:05:51.137892 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:51.137895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:51.138202 (+ 307us) server_negotiation.cc:407] Connection header received
0806 13:05:51.139254 (+ 1052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:51.139255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:51.139272 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:51.139355 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:51.140479 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.141142 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.142451 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.142709 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.142789 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.143882 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:51.143884 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:51.143884 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:51.143891 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:51.143913 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:51.143917 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:51.143979 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:51.144078 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 13:05:51.144116 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 13:05:51.144455 8465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.137755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:36055 (local address 127.20.245.131:44035)
0806 13:05:51.138012 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:51.138071 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:51.139071 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:51.139460 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:51.139466 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:51.139480 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:51.140363 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.140370 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.141252 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.141254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.142341 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.142344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.142805 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.142806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.142937 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.143718 (+ 781us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:51.143719 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:51.143758 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:51.143789 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:51.143988 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:51.143993 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:51.143996 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:05:51.144060 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 13:05:51.144168 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":102,"threads_started":1}
I20260806 13:05:51.145020 8463 heartbeater.cc:347] Connected to a master server at 127.20.245.190:36055
I20260806 13:05:51.145148 8463 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:51.145359 8463 heartbeater.cc:511] Master 127.20.245.190:36055 requested a full tablet report, sending...
I20260806 13:05:51.145853 8006 ts_manager.cc:194] Registered new tserver with Master: 60b7786a9a284973bc75619aa9fe0d0b (127.20.245.131:46795)
I20260806 13:05:51.146297 8006 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.131:44035
I20260806 13:05:51.151146 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:05:51.156906 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.153063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48574 (local address 127.20.245.190:36055)
0806 13:05:51.153158 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:51.153160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:51.153262 (+ 102us) server_negotiation.cc:407] Connection header received
0806 13:05:51.153354 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:51.153355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:51.153370 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:51.153434 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:51.153649 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.154302 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.155219 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.155457 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.155561 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.156521 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:51.156523 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:51.156523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:51.156531 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:51.156557 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:51.156563 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:51.156688 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:51.156774 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 13:05:51.156790 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 13:05:51.159273 8006 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:05:51.161466 8006 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:05:51.170018 8480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.165335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34998 (local address 127.20.245.130:39145)
0806 13:05:51.165566 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:51.165571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:51.166178 (+ 607us) server_negotiation.cc:407] Connection header received
0806 13:05:51.166305 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:51.166308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:51.166329 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:51.166432 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:51.166556 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.167835 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.168898 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.169485 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.169558 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.169715 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:51.169839 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 13:05:51.169894 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":124,"threads_started":1}
I20260806 13:05:51.170024 8479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.164921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34091 (local address 127.0.0.1:44278)
0806 13:05:51.165524 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:51.165535 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:51.165592 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:51.165900 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:51.165901 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:51.165903 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:51.165971 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.165973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.167495 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.167496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.168693 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.168696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.169619 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.169620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.169713 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.169735 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 13:05:51.169816 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 13:05:51.169899 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":26,"thread_start_us":67,"threads_started":1}
I20260806 13:05:51.170430 8476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.165056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44278 (local address 127.20.245.129:34091)
0806 13:05:51.165343 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:51.165350 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:51.165668 (+ 318us) server_negotiation.cc:407] Connection header received
0806 13:05:51.165727 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:51.165730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:51.165746 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:51.165817 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:51.166044 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.167363 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.168803 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.169501 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.169607 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.169724 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:51.170280 (+ 556us) server_negotiation.cc:299] Negotiation successful
0806 13:05:51.170339 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":114,"threads_started":1}
I20260806 13:05:51.170027 8475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.165170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:39145 (local address 127.0.0.1:34998)
0806 13:05:51.166075 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:51.166086 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:51.166140 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:51.166443 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:51.166444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:51.166447 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:51.166490 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.166491 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.167940 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.167941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.168794 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.168796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.169582 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.169584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.169708 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.169729 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 13:05:51.169820 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 13:05:51.169910 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":892,"mutex_wait_us":31,"thread_start_us":90,"threads_started":1}
I20260806 13:05:51.171422 8474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.164920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:46795 (local address 127.0.0.1:34334)
0806 13:05:51.165335 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:51.165389 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:51.165476 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:51.165774 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:51.165778 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:51.165781 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:51.165902 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.165905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.167095 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.167096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.168694 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.168696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.171068 (+ 2372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.171069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.171152 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.171157 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:51.171275 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 13:05:51.171337 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":117,"thread_start_us":98,"threads_started":1}
I20260806 13:05:51.171447 8477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.165028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.20.245.131:46795)
0806 13:05:51.165458 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:51.165461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:51.165473 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:05:51.165629 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:51.165632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:51.165652 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:51.165743 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:51.165981 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.167005 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.169776 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.170839 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.170927 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.171028 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:51.171298 (+ 270us) server_negotiation.cc:299] Negotiation successful
0806 13:05:51.171349 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":152,"threads_started":1}
I20260806 13:05:51.171526 8131 tablet_service.cc:1467] Processing CreateTablet for tablet 7f4ce263fa2c4142b28e53eac7098bc2 (DEFAULT_TABLE table=test-table [id=435d81df7fdc406db9e9c04cb91f0f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:51.172043 8131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f4ce263fa2c4142b28e53eac7098bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:51.172228 8397 tablet_service.cc:1467] Processing CreateTablet for tablet 7f4ce263fa2c4142b28e53eac7098bc2 (DEFAULT_TABLE table=test-table [id=435d81df7fdc406db9e9c04cb91f0f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:51.172626 8397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f4ce263fa2c4142b28e53eac7098bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:51.175806 8481 tablet_bootstrap.cc:492] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f: Bootstrap starting.
I20260806 13:05:51.176395 8264 tablet_service.cc:1467] Processing CreateTablet for tablet 7f4ce263fa2c4142b28e53eac7098bc2 (DEFAULT_TABLE table=test-table [id=435d81df7fdc406db9e9c04cb91f0f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:51.176679 8481 tablet_bootstrap.cc:654] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:51.176846 8264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f4ce263fa2c4142b28e53eac7098bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:51.177209 8481 log.cc:824] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:51.177675 8482 tablet_bootstrap.cc:492] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: Bootstrap starting.
I20260806 13:05:51.178138 8481 tablet_bootstrap.cc:492] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f: No bootstrap required, opened a new log
I20260806 13:05:51.178196 8481 ts_tablet_manager.cc:1397] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:51.178459 8482 tablet_bootstrap.cc:654] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:51.178861 8482 log.cc:824] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:51.179840 8482 tablet_bootstrap.cc:492] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: No bootstrap required, opened a new log
I20260806 13:05:51.179927 8482 ts_tablet_manager.cc:1397] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:51.180824 8481 raft_consensus.cc:348] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.181028 8481 raft_consensus.cc:374] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:51.181079 8481 raft_consensus.cc:729] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe26b895ed24f789e9ac53cf78b7c7f, State: Initialized, Role: FOLLOWER
I20260806 13:05:51.181341 8481 consensus_queue.cc:260] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.181692 8481 ts_tablet_manager.cc:1428] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 13:05:51.181735 8199 heartbeater.cc:503] Master 127.20.245.190:36055 was elected leader, sending a full tablet report...
I20260806 13:05:51.183182 8482 raft_consensus.cc:348] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.183439 8482 raft_consensus.cc:374] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:51.183425 8485 tablet_bootstrap.cc:492] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Bootstrap starting.
I20260806 13:05:51.183492 8482 raft_consensus.cc:729] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60b7786a9a284973bc75619aa9fe0d0b, State: Initialized, Role: FOLLOWER
I20260806 13:05:51.183632 8482 consensus_queue.cc:260] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.183986 8482 ts_tablet_manager.cc:1428] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 13:05:51.184037 8463 heartbeater.cc:503] Master 127.20.245.190:36055 was elected leader, sending a full tablet report...
I20260806 13:05:51.184370 8485 tablet_bootstrap.cc:654] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:51.184871 8485 log.cc:824] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:51.186246 8485 tablet_bootstrap.cc:492] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: No bootstrap required, opened a new log
I20260806 13:05:51.186357 8485 ts_tablet_manager.cc:1397] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:05:51.189116 8485 raft_consensus.cc:348] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.189335 8485 raft_consensus.cc:374] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:51.189365 8485 raft_consensus.cc:729] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4e68fba4187456f92056984ae378f27, State: Initialized, Role: FOLLOWER
I20260806 13:05:51.189531 8485 consensus_queue.cc:260] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.189934 8485 ts_tablet_manager.cc:1428] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 13:05:51.189967 8330 heartbeater.cc:503] Master 127.20.245.190:36055 was elected leader, sending a full tablet report...
W20260806 13:05:51.237269 8331 tablet.cc:2369] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:51.319466 8489 raft_consensus.cc:482] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:51.319659 8489 raft_consensus.cc:504] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.320218 8489 leader_election.cc:288] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60b7786a9a284973bc75619aa9fe0d0b (127.20.245.131:46795), bbe26b895ed24f789e9ac53cf78b7c7f (127.20.245.129:34091)
I20260806 13:05:51.323737 8332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.320504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34091 (local address 127.20.245.130:54437)
0806 13:05:51.320604 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:51.320620 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:51.320689 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:51.320910 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:51.320911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:51.320913 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:51.321018 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.321021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.321886 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.321887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.322773 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.322776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.323410 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.323411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.323494 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.323498 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:51.323580 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 13:05:51.323635 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":4}
I20260806 13:05:51.323730 8476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.320604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:54437 (local address 127.20.245.129:34091)
0806 13:05:51.320676 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:51.320680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:51.320697 (+ 17us) server_negotiation.cc:407] Connection header received
0806 13:05:51.320778 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:51.320779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:51.320797 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:51.320891 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:51.321116 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.321774 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.322883 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.323317 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.323412 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.323424 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:51.323588 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 13:05:51.323635 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 13:05:51.323988 8477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.320772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:38073 (local address 127.20.245.131:46795)
0806 13:05:51.320831 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:51.320833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:51.320976 (+ 143us) server_negotiation.cc:407] Connection header received
0806 13:05:51.321030 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:51.321031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:51.321043 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:51.321118 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:51.321305 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.321906 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.323023 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.323523 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.323628 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.323638 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:51.323818 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 13:05:51.323878 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 13:05:51.324222 8490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.320515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:46795 (local address 127.20.245.130:38073)
0806 13:05:51.320879 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:51.320889 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:51.320952 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:51.321143 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:51.321144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:51.321146 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:51.321216 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.321217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.322029 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.322030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.322904 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:51.322906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.323629 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.323630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:51.323720 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.323723 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:05:51.323964 (+ 241us) client_negotiation.cc:240] Negotiation successful
0806 13:05:51.324019 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":73,"thread_start_us":187,"threads_started":1}
I20260806 13:05:51.324198 8151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4ce263fa2c4142b28e53eac7098bc2" candidate_uuid: "c4e68fba4187456f92056984ae378f27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" is_pre_election: true
I20260806 13:05:51.324483 8151 raft_consensus.cc:2454] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4e68fba4187456f92056984ae378f27 in term 0.
I20260806 13:05:51.324810 8220 leader_election.cc:302] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe26b895ed24f789e9ac53cf78b7c7f, c4e68fba4187456f92056984ae378f27; no voters:
I20260806 13:05:51.324815 8417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4ce263fa2c4142b28e53eac7098bc2" candidate_uuid: "c4e68fba4187456f92056984ae378f27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60b7786a9a284973bc75619aa9fe0d0b" is_pre_election: true
I20260806 13:05:51.324985 8417 raft_consensus.cc:2454] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4e68fba4187456f92056984ae378f27 in term 0.
I20260806 13:05:51.324971 8489 raft_consensus.cc:2781] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:05:51.325057 8489 raft_consensus.cc:482] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:05:51.325114 8489 raft_consensus.cc:3037] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:51.326068 8489 raft_consensus.cc:504] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.326289 8489 leader_election.cc:288] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [CANDIDATE]: Term 1 election: Requested vote from peers 60b7786a9a284973bc75619aa9fe0d0b (127.20.245.131:46795), bbe26b895ed24f789e9ac53cf78b7c7f (127.20.245.129:34091)
I20260806 13:05:51.326490 8151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4ce263fa2c4142b28e53eac7098bc2" candidate_uuid: "c4e68fba4187456f92056984ae378f27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f"
I20260806 13:05:51.326531 8417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4ce263fa2c4142b28e53eac7098bc2" candidate_uuid: "c4e68fba4187456f92056984ae378f27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60b7786a9a284973bc75619aa9fe0d0b"
I20260806 13:05:51.326586 8151 raft_consensus.cc:3037] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:51.326663 8417 raft_consensus.cc:3037] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:51.327594 8151 raft_consensus.cc:2454] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4e68fba4187456f92056984ae378f27 in term 1.
I20260806 13:05:51.327661 8417 raft_consensus.cc:2454] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4e68fba4187456f92056984ae378f27 in term 1.
I20260806 13:05:51.327848 8220 leader_election.cc:302] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe26b895ed24f789e9ac53cf78b7c7f, c4e68fba4187456f92056984ae378f27; no voters:
I20260806 13:05:51.327972 8489 raft_consensus.cc:2781] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:51.328148 8489 raft_consensus.cc:686] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 1 LEADER]: Becoming Leader. State: Replica: c4e68fba4187456f92056984ae378f27, State: Running, Role: LEADER
I20260806 13:05:51.328320 8489 consensus_queue.cc:237] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } }
I20260806 13:05:51.329459 8006 catalog_manager.cc:5495] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4e68fba4187456f92056984ae378f27 (127.20.245.130). New cstate: current_term: 1 leader_uuid: "c4e68fba4187456f92056984ae378f27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4e68fba4187456f92056984ae378f27" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 39145 } health_report { overall_health: HEALTHY } } }
W20260806 13:05:51.333766 8200 tablet.cc:2369] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:51.355808 8480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.353023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35004 (local address 127.20.245.130:39145)
0806 13:05:51.353103 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:51.353106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:51.353123 (+ 17us) server_negotiation.cc:407] Connection header received
0806 13:05:51.353169 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:51.353170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:51.353197 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:51.353292 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:05:51.353506 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.354031 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.354866 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:51.355075 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:51.355159 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:51.355384 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:05:51.355491 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:05:51.355614 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:51.355646 (+ 32us) server_negotiation.cc:299] Negotiation successful
0806 13:05:51.355661 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:05:51.358307 8151 raft_consensus.cc:1261] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 1 FOLLOWER]: Refusing update from remote peer c4e68fba4187456f92056984ae378f27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:51.358340 8417 raft_consensus.cc:1261] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 1 FOLLOWER]: Refusing update from remote peer c4e68fba4187456f92056984ae378f27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:51.358821 8491 consensus_queue.cc:1035] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60b7786a9a284973bc75619aa9fe0d0b" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 46795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:51.358989 8489 consensus_queue.cc:1035] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe26b895ed24f789e9ac53cf78b7c7f" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:51.362473 8496 mvcc.cc:205] Tried to move back new op lower bound from 7315544274360020992 to 7315544274241630208. Current Snapshot: MvccSnapshot[applied={T|T < 7315544274360020992}]
I20260806 13:05:51.363220 8494 mvcc.cc:205] Tried to move back new op lower bound from 7315544274360020992 to 7315544274241630208. Current Snapshot: MvccSnapshot[applied={T|T < 7315544274360020992 or (T in {7315544274360020992})}]
I20260806 13:05:51.365216 8005 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:51.365348 8005 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:51.366483 8005 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f981b251b0694440a6428138dce55796: Sending DeleteTablet for 3 replicas of tablet 7f4ce263fa2c4142b28e53eac7098bc2
I20260806 13:05:51.367015 8264 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f4ce263fa2c4142b28e53eac7098bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:51 UTC) from {username='slave'} at 127.0.0.1:34998
I20260806 13:05:51.367039 8131 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f4ce263fa2c4142b28e53eac7098bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:51 UTC) from {username='slave'} at 127.0.0.1:44278
I20260806 13:05:51.367409 8503 tablet_replica.cc:330] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: stopping tablet replica
I20260806 13:05:51.367478 8504 tablet_replica.cc:330] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f: stopping tablet replica
I20260806 13:05:51.367626 8504 raft_consensus.cc:2229] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:51.367626 8503 raft_consensus.cc:2229] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:05:51.367693 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 8067
I20260806 13:05:51.367807 8504 raft_consensus.cc:2258] T 7f4ce263fa2c4142b28e53eac7098bc2 P bbe26b895ed24f789e9ac53cf78b7c7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:51.367937 8503 raft_consensus.cc:2258] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:51.371676 8503 ts_tablet_manager.cc:1905] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:51.373639 8397 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f4ce263fa2c4142b28e53eac7098bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:51 UTC) from {username='slave'} at 127.0.0.1:34334
I20260806 13:05:51.374061 8505 tablet_replica.cc:330] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: stopping tablet replica
I20260806 13:05:51.374260 8505 raft_consensus.cc:2229] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:51.374241 8503 ts_tablet_manager.cc:1918] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:51.374351 8503 log.cc:1196] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/7f4ce263fa2c4142b28e53eac7098bc2
I20260806 13:05:51.374455 8505 raft_consensus.cc:2258] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:51.374706 8503 ts_tablet_manager.cc:1939] T 7f4ce263fa2c4142b28e53eac7098bc2 P c4e68fba4187456f92056984ae378f27: Deleting consensus metadata
I20260806 13:05:51.375468 7993 catalog_manager.cc:4841] TS c4e68fba4187456f92056984ae378f27 (127.20.245.130:39145): tablet 7f4ce263fa2c4142b28e53eac7098bc2 (table test-table [id=435d81df7fdc406db9e9c04cb91f0f06]) successfully deleted
W20260806 13:05:51.379221 7993 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:34091 (error 108)
I20260806 13:05:51.379674 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 8202
I20260806 13:05:51.379725 8505 ts_tablet_manager.cc:1905] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:51.382005 8474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:51.381800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:34091 (local address 127.0.0.1:44286)
0806 13:05:51.381882 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:51.381942 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:34091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 13:05:51.382164 7993 catalog_manager.cc:4584] TS bbe26b895ed24f789e9ac53cf78b7c7f (127.20.245.129:34091): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7f4ce263fa2c4142b28e53eac7098bc2: Network error: Client connection negotiation failed: client connection to 127.20.245.129:34091: connect: Connection refused (error 111)
I20260806 13:05:51.382489 8505 ts_tablet_manager.cc:1918] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:51.382606 8505 log.cc:1196] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/7f4ce263fa2c4142b28e53eac7098bc2
I20260806 13:05:51.382925 8505 ts_tablet_manager.cc:1939] T 7f4ce263fa2c4142b28e53eac7098bc2 P 60b7786a9a284973bc75619aa9fe0d0b: Deleting consensus metadata
I20260806 13:05:51.384018 7990 catalog_manager.cc:4841] TS 60b7786a9a284973bc75619aa9fe0d0b (127.20.245.131:46795): tablet 7f4ce263fa2c4142b28e53eac7098bc2 (table test-table [id=435d81df7fdc406db9e9c04cb91f0f06]) successfully deleted
I20260806 13:05:51.387562 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 8334
I20260806 13:05:51.396514 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 7974
2026-08-06T13:05:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (950 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:05:51 dist-test-slave-srgv krb5kdc[8509](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:05:51 dist-test-slave-srgv krb5kdc[8509](info): set up 2 sockets
Aug 06 13:05:51 dist-test-slave-srgv krb5kdc[8509](info): commencing operation
krb5kdc: starting...
W20260806 13:05:52.517154 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:05:52 dist-test-slave-srgv krb5kdc[8509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:05:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:05:52.667896 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35909
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:35909
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:52.762261 8522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:52.762552 8522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:52.762580 8522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:52.763870 8522 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:52.763921 8522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:52.763935 8522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:52.763948 8522 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:52.763962 8522 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:52.765707 8522 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:35909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:52.765959 8522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:52.766182 8522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:52.772028 8530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:52.771998 8528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:52.771996 8527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:52.772248 8522 server_base.cc:1034] running on GCE node
I20260806 13:05:52.772569 8522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:52.772933 8522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:52.774089 8522 hybrid_clock.cc:648] HybridClock initialized: now 1786021552774060 us; error 48 us; skew 500 ppm
Aug 06 13:05:52 dist-test-slave-srgv krb5kdc[8509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021552, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:52.777609 8522 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:05:52.778311 8522 webserver.cc:460] Webserver started at http://127.20.245.190:36063/ using document root <none> and password file <none>
I20260806 13:05:52.778613 8522 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:52.778689 8522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:52.778860 8522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:52.780270 8522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "f1b0e7c126384672aae7660785271a0f"
format_stamp: "Formatted at 2026-08-06 13:05:52 on dist-test-slave-srgv"
server_key: "1e5a382c422ff2934a726b750c62b65e"
server_key_iv: "1f5991bf64ec9486c3c6796343874f84"
server_key_version: "encryptionkey@0"
I20260806 13:05:52.780720 8522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "f1b0e7c126384672aae7660785271a0f"
format_stamp: "Formatted at 2026-08-06 13:05:52 on dist-test-slave-srgv"
server_key: "1e5a382c422ff2934a726b750c62b65e"
server_key_iv: "1f5991bf64ec9486c3c6796343874f84"
server_key_version: "encryptionkey@0"
I20260806 13:05:52.782455 8522 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 13:05:52.783492 8537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:52.783713 8522 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:05:52.783845 8522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "f1b0e7c126384672aae7660785271a0f"
format_stamp: "Formatted at 2026-08-06 13:05:52 on dist-test-slave-srgv"
server_key: "1e5a382c422ff2934a726b750c62b65e"
server_key_iv: "1f5991bf64ec9486c3c6796343874f84"
server_key_version: "encryptionkey@0"
I20260806 13:05:52.783941 8522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:52.809773 8522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:52.812882 8522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:52.813123 8522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:52.819585 8522 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:35909
I20260806 13:05:52.819648 8589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:35909 every 8 connection(s)
I20260806 13:05:52.820199 8522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:52.821762 8590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:52.825439 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 8522
I20260806 13:05:52.825608 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:52.825680 8590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f: Bootstrap starting.
I20260806 13:05:52.825898 21462 external_mini_cluster.cc:1428] Setting key 347012066805d8b96058415f26489c74
I20260806 13:05:52.826751 8590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:52.827375 8590 log.cc:824] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:52.828508 8590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f: No bootstrap required, opened a new log
I20260806 13:05:52.831274 8590 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b0e7c126384672aae7660785271a0f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35909 } }
I20260806 13:05:52.831540 8590 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:52.831602 8590 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b0e7c126384672aae7660785271a0f, State: Initialized, Role: FOLLOWER
I20260806 13:05:52.831800 8590 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b0e7c126384672aae7660785271a0f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35909 } }
I20260806 13:05:52.831915 8590 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:52.831967 8590 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:52.832026 8590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:52.833079 8590 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b0e7c126384672aae7660785271a0f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35909 } }
I20260806 13:05:52.833230 8590 leader_election.cc:302] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1b0e7c126384672aae7660785271a0f; no voters:
I20260806 13:05:52.833485 8590 leader_election.cc:288] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:52.833609 8595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:52.833861 8595 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [term 1 LEADER]: Becoming Leader. State: Replica: f1b0e7c126384672aae7660785271a0f, State: Running, Role: LEADER
I20260806 13:05:52.833988 8590 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:52.834036 8595 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b0e7c126384672aae7660785271a0f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35909 } }
I20260806 13:05:52.834615 8596 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1b0e7c126384672aae7660785271a0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b0e7c126384672aae7660785271a0f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35909 } } }
I20260806 13:05:52.834738 8596 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [sys.catalog]: This master's current role is: LEADER
Aug 06 13:05:52 dist-test-slave-srgv krb5kdc[8509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:52.835160 8597 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1b0e7c126384672aae7660785271a0f. Latest consensus state: current_term: 1 leader_uuid: "f1b0e7c126384672aae7660785271a0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b0e7c126384672aae7660785271a0f" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35909 } } }
I20260806 13:05:52.835279 8597 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:52.835650 8602 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:52.836773 8602 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:52.839418 8602 catalog_manager.cc:1347] Generated new cluster ID: 5d36c89b92e3485a93f549d33f06a5fb
I20260806 13:05:52.839483 8602 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:05:52.840502 8593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:52.826672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42868 (local address 127.20.245.190:35909)
0806 13:05:52.826887 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:52.826902 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:52.826935 (+ 33us) server_negotiation.cc:407] Connection header received
0806 13:05:52.827695 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:52.827707 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:52.827786 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:52.827980 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:52.828985 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:52.830065 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:52.831425 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:52.831990 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:52.832199 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:52.835853 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:52.835859 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:52.835860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:52.835877 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:52.838314 (+ 2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:52.838852 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:52.838855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:52.838856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:52.838956 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:52.839290 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:52.839291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:52.839292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:52.839694 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:52.839885 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:52.840064 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 13:05:52.840234 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":108,"threads_started":1}
I20260806 13:05:52.850917 8602 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:52.851835 8602 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:52.861655 8602 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f: Generated new TSK 0
I20260806 13:05:52.861982 8602 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.245.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
Entry for principal kudu/127.20.245.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab.
I20260806 13:05:52.899813 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35909
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:53.006426 8616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:53.006803 8616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:53.006861 8616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:53.008610 8616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:53.008726 8616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:53.008786 8616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:05:53.010967 8616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.129.keytab
--principal=kudu/127.20.245.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:53.011428 8616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:53.011821 8616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:53.018723 8624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:53.018762 8622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:53.018821 8616 server_base.cc:1034] running on GCE node
W20260806 13:05:53.018844 8621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:53.019341 8616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:53.019660 8616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:53.020857 8616 hybrid_clock.cc:648] HybridClock initialized: now 1786021553020824 us; error 49 us; skew 500 ppm
Aug 06 13:05:53 dist-test-slave-srgv krb5kdc[8509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021553, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:53.024479 8616 init.cc:377] Logged in from keytab as kudu/127.20.245.129@KRBTEST.COM (short username kudu)
I20260806 13:05:53.025094 8616 webserver.cc:460] Webserver started at http://127.20.245.129:33471/ using document root <none> and password file <none>
I20260806 13:05:53.025422 8616 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:53.025477 8616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:53.025684 8616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:53.027037 8616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "e043d05e07c14858b0754a7ab12bbda9"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "c9ce440f65d7948fe104da5a39a756a4"
server_key_iv: "143b946ce2a4c4e1e57761f5b1e0661c"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.027554 8616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "e043d05e07c14858b0754a7ab12bbda9"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "c9ce440f65d7948fe104da5a39a756a4"
server_key_iv: "143b946ce2a4c4e1e57761f5b1e0661c"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.029244 8616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:53.030297 8631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.030687 8616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:53.030820 8616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "e043d05e07c14858b0754a7ab12bbda9"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "c9ce440f65d7948fe104da5a39a756a4"
server_key_iv: "143b946ce2a4c4e1e57761f5b1e0661c"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.030917 8616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:53.060268 8616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:53.063318 8616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:53.063534 8616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:53.063969 8616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:53.064469 8616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:53.064514 8616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.064541 8616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:53.064556 8616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.072328 8616 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:39415
I20260806 13:05:53.072412 8745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:39415 every 8 connection(s)
I20260806 13:05:53.072839 8616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:05:53.078577 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 8616
I20260806 13:05:53.078703 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:05:53.079002 21462 external_mini_cluster.cc:1428] Setting key e3e46e254ffdbea5cb2ef070138d7c8e
Aug 06 13:05:53 dist-test-slave-srgv krb5kdc[8509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021553, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.129@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:53.084972 8593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.073907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:37025 (local address 127.20.245.190:35909)
0806 13:05:53.074052 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.074055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.074288 (+ 233us) server_negotiation.cc:407] Connection header received
0806 13:05:53.074965 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.074967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.074981 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.075053 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:53.076286 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.076877 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.078033 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.078306 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.078410 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.081503 (+ 3093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:53.081505 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:53.081506 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:53.081518 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:53.083322 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:53.083866 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:53.083867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:53.083868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:53.083926 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:53.084217 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:53.084218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:53.084218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:53.084354 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:53.084410 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.084778 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.084885 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 13:05:53.085319 8748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.073848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35909 (local address 127.20.245.129:37025)
0806 13:05:53.074086 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.074180 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:53.074843 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:53.075147 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:53.075152 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:53.075913 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:53.076168 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.076172 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.076999 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.077000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.077924 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.077927 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.078428 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.078429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.078580 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.079343 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:53.079353 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:53.081385 (+ 2032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:53.083407 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:53.083416 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:53.083419 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:53.083788 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:53.083990 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:53.083992 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:53.083992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:53.084153 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:53.084422 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:53.084429 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:53.084634 (+ 205us) client_negotiation.cc:769] Sending connection context
0806 13:05:53.084759 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 13:05:53.084982 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":101,"threads_started":1}
I20260806 13:05:53.086020 8746 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35909
I20260806 13:05:53.086150 8746 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:53.086428 8746 heartbeater.cc:511] Master 127.20.245.190:35909 requested a full tablet report, sending...
I20260806 13:05:53.087285 8554 ts_manager.cc:194] Registered new tserver with Master: e043d05e07c14858b0754a7ab12bbda9 (127.20.245.129:39415)
I20260806 13:05:53.088061 8554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.129@KRBTEST.COM'} at 127.20.245.129:37025
WARNING: no policy specified for kudu/127.20.245.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
Entry for principal kudu/127.20.245.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab.
I20260806 13:05:53.114171 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35909
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:53.211496 8751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:53.211812 8751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:53.211844 8751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:53.213337 8751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:53.213415 8751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:53.213451 8751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:05:53.215411 8751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.130.keytab
--principal=kudu/127.20.245.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:53.215735 8751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:53.215998 8751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:53.222779 8756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:53.222793 8757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:53.222810 8759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:53.223332 8751 server_base.cc:1034] running on GCE node
I20260806 13:05:53.223618 8751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:53.223937 8751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:53.225189 8751 hybrid_clock.cc:648] HybridClock initialized: now 1786021553225145 us; error 51 us; skew 500 ppm
Aug 06 13:05:53 dist-test-slave-srgv krb5kdc[8509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021553, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:53.228890 8751 init.cc:377] Logged in from keytab as kudu/127.20.245.130@KRBTEST.COM (short username kudu)
I20260806 13:05:53.229682 8751 webserver.cc:460] Webserver started at http://127.20.245.130:35055/ using document root <none> and password file <none>
I20260806 13:05:53.230000 8751 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:53.230095 8751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:53.230288 8751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:53.231819 8751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "3d1e4e71221c4cee87c009b46fb7e292"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "2779e51feb2851c1472eb3d0d7edfb99"
server_key_iv: "6107bc7dac04c6fbd67597366b366b95"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.232317 8751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "3d1e4e71221c4cee87c009b46fb7e292"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "2779e51feb2851c1472eb3d0d7edfb99"
server_key_iv: "6107bc7dac04c6fbd67597366b366b95"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.234289 8751 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:05:53.235689 8766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.235965 8751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:05:53.236161 8751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "3d1e4e71221c4cee87c009b46fb7e292"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "2779e51feb2851c1472eb3d0d7edfb99"
server_key_iv: "6107bc7dac04c6fbd67597366b366b95"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.236274 8751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:53.256518 8751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:53.259534 8751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:53.259750 8751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:53.260093 8751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:53.260710 8751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:53.260794 8751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.260845 8751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:53.260877 8751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.268270 8751 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:38577
I20260806 13:05:53.268324 8881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:38577 every 8 connection(s)
I20260806 13:05:53.268749 8751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:05:53.271828 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 8751
I20260806 13:05:53.271962 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:05:53.272262 21462 external_mini_cluster.cc:1428] Setting key 0d53cf35c1027beb6d0499fafdc7d1b3
Aug 06 13:05:53 dist-test-slave-srgv krb5kdc[8509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021553, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.130@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:53.281859 8593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.269668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:41099 (local address 127.20.245.190:35909)
0806 13:05:53.269755 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.269757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.270011 (+ 254us) server_negotiation.cc:407] Connection header received
0806 13:05:53.270649 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.270651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.270665 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.270755 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:53.272232 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.272992 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.274257 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.274503 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.274602 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.277641 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:53.277644 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:53.277645 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:53.277655 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:53.279855 (+ 2200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:53.280466 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:53.280467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:53.280468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:53.280550 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:53.280945 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:53.280946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:53.280946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:53.281147 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:53.281229 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.281583 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.281721 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 13:05:53.282095 8884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.269626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35909 (local address 127.20.245.130:41099)
0806 13:05:53.269848 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.269898 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:53.270515 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:53.270871 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:53.270876 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:53.271748 (+ 872us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:53.272085 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.272092 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.273105 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.273106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.274109 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.274112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.274614 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.274615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.274780 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.275480 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:53.275490 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:53.277497 (+ 2007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:53.279991 (+ 2494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:53.280005 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:53.280008 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:53.280366 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:53.280684 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:53.280685 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:53.280685 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:53.280859 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:53.281240 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:53.281247 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:53.281416 (+ 169us) client_negotiation.cc:769] Sending connection context
0806 13:05:53.281527 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 13:05:53.281707 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":126,"threads_started":1}
I20260806 13:05:53.282837 8882 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35909
I20260806 13:05:53.282974 8882 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.20.245.131@KRBTEST.COM; defaulting to no policy
I20260806 13:05:53.283324 8882 heartbeater.cc:511] Master 127.20.245.190:35909 requested a full tablet report, sending...
I20260806 13:05:53.283900 8554 ts_manager.cc:194] Registered new tserver with Master: 3d1e4e71221c4cee87c009b46fb7e292 (127.20.245.130:38577)
I20260806 13:05:53.284474 8554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.130@KRBTEST.COM'} at 127.20.245.130:41099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
Entry for principal kudu/127.20.245.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab.
I20260806 13:05:53.308554 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35909
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:53.411372 8887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:53.411720 8887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:53.411772 8887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:53.413241 8887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:53.413347 8887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:53.413400 8887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:05:53.415269 8887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.131.keytab
--principal=kudu/127.20.245.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:35909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:53.415618 8887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:53.415935 8887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:53.422175 8892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:53.422184 8893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:53.422289 8895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:53.422551 8887 server_base.cc:1034] running on GCE node
I20260806 13:05:53.422787 8887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:53.423075 8887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:53.424248 8887 hybrid_clock.cc:648] HybridClock initialized: now 1786021553424237 us; error 34 us; skew 500 ppm
Aug 06 13:05:53 dist-test-slave-srgv krb5kdc[8509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021553, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:53.427330 8887 init.cc:377] Logged in from keytab as kudu/127.20.245.131@KRBTEST.COM (short username kudu)
I20260806 13:05:53.427887 8887 webserver.cc:460] Webserver started at http://127.20.245.131:41829/ using document root <none> and password file <none>
I20260806 13:05:53.428171 8887 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:53.428222 8887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:53.428391 8887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:53.429688 8887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "4523161dc65945fda595e523980f995d"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "49c382fe55ae2d3f5d8fa0188d0a20d3"
server_key_iv: "b9e595168e89b2f0c19ade690abaaa08"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.430120 8887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "4523161dc65945fda595e523980f995d"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "49c382fe55ae2d3f5d8fa0188d0a20d3"
server_key_iv: "b9e595168e89b2f0c19ade690abaaa08"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.431777 8887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260806 13:05:53.432669 8902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.432873 8887 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:53.432972 8887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "4523161dc65945fda595e523980f995d"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "49c382fe55ae2d3f5d8fa0188d0a20d3"
server_key_iv: "b9e595168e89b2f0c19ade690abaaa08"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.433053 8887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:53.463784 8887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:53.467345 8887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:53.467545 8887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:53.467931 8887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:53.468379 8887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:53.468430 8887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.468461 8887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:53.468513 8887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.476289 8887 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:34655
I20260806 13:05:53.476323 9016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:34655 every 8 connection(s)
I20260806 13:05:53.476845 8887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
Aug 06 13:05:53 dist-test-slave-srgv krb5kdc[8509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021553, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.131@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:05:53.486676 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 8887
I20260806 13:05:53.486848 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:05:53.487120 21462 external_mini_cluster.cc:1428] Setting key 63e9a8d47f84071577a58a32a7200af9
I20260806 13:05:53.489377 8593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.477930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:33369 (local address 127.20.245.190:35909)
0806 13:05:53.478002 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.478004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.478273 (+ 269us) server_negotiation.cc:407] Connection header received
0806 13:05:53.478906 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.478908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.478923 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.479000 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:53.480290 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.480881 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.482226 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.482450 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.482524 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.485338 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:53.485339 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:53.485340 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:53.485351 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:53.487371 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:53.487973 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:53.487974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:53.487975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:53.488050 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:53.488493 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:53.488494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:53.488495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:53.488675 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:53.488764 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.489110 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.489243 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 13:05:53.489697 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.477898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:35909 (local address 127.20.245.131:33369)
0806 13:05:53.478085 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.478137 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:53.478768 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:53.479084 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:53.479087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:53.479889 (+ 802us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:53.480146 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.480151 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.481003 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.481004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.482026 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.482028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.482562 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.482564 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.482715 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.483593 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:05:53.483603 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:53.485203 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:53.487473 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:53.487483 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:53.487487 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:53.487863 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:53.488131 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:05:53.488132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:05:53.488133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:05:53.488312 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:05:53.488752 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:53.488760 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:53.488947 (+ 187us) client_negotiation.cc:769] Sending connection context
0806 13:05:53.489085 (+ 138us) client_negotiation.cc:240] Negotiation successful
0806 13:05:53.489348 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260806 13:05:53.490543 9017 heartbeater.cc:347] Connected to a master server at 127.20.245.190:35909
I20260806 13:05:53.490674 9017 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:53.490978 9017 heartbeater.cc:511] Master 127.20.245.190:35909 requested a full tablet report, sending...
I20260806 13:05:53.491626 8554 ts_manager.cc:194] Registered new tserver with Master: 4523161dc65945fda595e523980f995d (127.20.245.131:34655)
I20260806 13:05:53.492105 8554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.245.131@KRBTEST.COM'} at 127.20.245.131:33369
I20260806 13:05:53.499998 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:05:53.509274 8593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.501859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42874 (local address 127.20.245.190:35909)
0806 13:05:53.501933 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.501935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.502082 (+ 147us) server_negotiation.cc:407] Connection header received
0806 13:05:53.502127 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.502128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.502145 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.502198 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:53.502939 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.503658 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.504411 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.504644 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.504710 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.506095 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:53.506097 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:53.506097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:53.506104 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:53.507766 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:53.508269 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:53.508270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:53.508270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:53.508344 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:53.508593 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:53.508594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:53.508594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:53.508811 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:53.508917 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.509091 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.509184 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 13:05:53.511745 8554 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:05:53.513962 8554 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:05:53.522425 9033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.517950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56690 (local address 127.20.245.130:38577)
0806 13:05:53.518205 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.518212 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.518228 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:05:53.518285 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.518288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.518308 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.518414 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:53.518711 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.520134 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.521236 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.521923 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.522007 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.522074 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.522252 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.522309 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":113,"threads_started":1}
I20260806 13:05:53.522415 9029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.517569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:38577 (local address 127.0.0.1:56690)
0806 13:05:53.517824 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.517884 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:53.518060 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:53.518434 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:53.518437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:53.518442 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:53.518614 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.518617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.520251 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.520252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.521126 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.521129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.522022 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.522022 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.522111 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.522129 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 13:05:53.522215 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 13:05:53.522293 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":53,"thread_start_us":70,"threads_started":1}
I20260806 13:05:53.522912 9030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.517569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39415 (local address 127.0.0.1:34226)
0806 13:05:53.517960 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.517972 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:53.518227 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:53.518435 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:53.518437 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:53.518440 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:53.518670 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.518675 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.520191 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.520192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.521497 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.521500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.522707 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.522708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.522777 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.522784 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 13:05:53.522816 (+ 32us) client_negotiation.cc:240] Negotiation successful
0806 13:05:53.522853 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":183,"thread_start_us":108,"threads_started":1}
I20260806 13:05:53.523063 9028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.517569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:34655 (local address 127.0.0.1:36956)
0806 13:05:53.518575 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.518586 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:53.518651 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:53.518860 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:53.518860 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:53.518863 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:53.518910 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.518911 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.519998 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.519999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.521497 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.521500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.522519 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.522520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.522860 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.522865 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:53.522942 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 13:05:53.522992 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":993,"mutex_wait_us":29,"thread_start_us":132,"threads_started":1}
I20260806 13:05:53.523111 9031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.517707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36956 (local address 127.20.245.131:34655)
0806 13:05:53.518381 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.518387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.518669 (+ 282us) server_negotiation.cc:407] Connection header received
0806 13:05:53.518730 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.518733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.518753 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.518862 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:53.518967 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.519875 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.521597 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.522351 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.522427 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.522479 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.522966 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.523016 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":119,"threads_started":1}
I20260806 13:05:53.523765 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.517948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34226 (local address 127.20.245.129:39415)
0806 13:05:53.518263 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.518267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.518278 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:05:53.518322 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.518324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.518345 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.518432 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:53.518758 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.520054 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.521610 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.522265 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.523514 (+ 1249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.523588 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.523616 (+ 28us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.523666 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":120,"threads_started":1}
I20260806 13:05:53.523932 8951 tablet_service.cc:1467] Processing CreateTablet for tablet f0e472874d0e4d44955b41359d17ee6b (DEFAULT_TABLE table=test-table [id=9e616eebce2840b28bdc51b2f41ddec6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:53.523933 8815 tablet_service.cc:1467] Processing CreateTablet for tablet f0e472874d0e4d44955b41359d17ee6b (DEFAULT_TABLE table=test-table [id=9e616eebce2840b28bdc51b2f41ddec6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:53.524374 8951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e472874d0e4d44955b41359d17ee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:53.524377 8815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e472874d0e4d44955b41359d17ee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:53.524492 8678 tablet_service.cc:1467] Processing CreateTablet for tablet f0e472874d0e4d44955b41359d17ee6b (DEFAULT_TABLE table=test-table [id=9e616eebce2840b28bdc51b2f41ddec6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:53.524829 8678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e472874d0e4d44955b41359d17ee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:53.527791 9034 tablet_bootstrap.cc:492] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: Bootstrap starting.
I20260806 13:05:53.528376 9035 tablet_bootstrap.cc:492] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: Bootstrap starting.
I20260806 13:05:53.528563 9036 tablet_bootstrap.cc:492] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9: Bootstrap starting.
I20260806 13:05:53.528949 9034 tablet_bootstrap.cc:654] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:53.529188 9035 tablet_bootstrap.cc:654] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:53.529326 9036 tablet_bootstrap.cc:654] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:53.529798 9035 log.cc:824] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:53.529801 9034 log.cc:824] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:53.529994 9036 log.cc:824] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:53.530835 9036 tablet_bootstrap.cc:492] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9: No bootstrap required, opened a new log
I20260806 13:05:53.530869 9034 tablet_bootstrap.cc:492] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: No bootstrap required, opened a new log
I20260806 13:05:53.530905 9036 ts_tablet_manager.cc:1397] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:53.530936 9034 ts_tablet_manager.cc:1397] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:05:53.530994 9035 tablet_bootstrap.cc:492] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: No bootstrap required, opened a new log
I20260806 13:05:53.531055 9035 ts_tablet_manager.cc:1397] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:05:53.532574 9036 raft_consensus.cc:348] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.532778 9036 raft_consensus.cc:374] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:53.532826 9036 raft_consensus.cc:729] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e043d05e07c14858b0754a7ab12bbda9, State: Initialized, Role: FOLLOWER
I20260806 13:05:53.533030 9036 consensus_queue.cc:260] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.533375 9036 ts_tablet_manager.cc:1428] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 13:05:53.533268 9034 raft_consensus.cc:348] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.533268 9035 raft_consensus.cc:348] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.533452 9035 raft_consensus.cc:374] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:53.533514 9035 raft_consensus.cc:729] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1e4e71221c4cee87c009b46fb7e292, State: Initialized, Role: FOLLOWER
I20260806 13:05:53.533452 9034 raft_consensus.cc:374] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:53.533561 9034 raft_consensus.cc:729] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4523161dc65945fda595e523980f995d, State: Initialized, Role: FOLLOWER
I20260806 13:05:53.533602 8746 heartbeater.cc:503] Master 127.20.245.190:35909 was elected leader, sending a full tablet report...
I20260806 13:05:53.533638 9035 consensus_queue.cc:260] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.533679 9034 consensus_queue.cc:260] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.533977 9035 ts_tablet_manager.cc:1428] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 13:05:53.533977 9034 ts_tablet_manager.cc:1428] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 13:05:53.534032 8882 heartbeater.cc:503] Master 127.20.245.190:35909 was elected leader, sending a full tablet report...
I20260806 13:05:53.534097 9017 heartbeater.cc:503] Master 127.20.245.190:35909 was elected leader, sending a full tablet report...
W20260806 13:05:53.573956 8747 tablet.cc:2369] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:53.586370 9042 raft_consensus.cc:482] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:53.586576 9042 raft_consensus.cc:504] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.587230 9042 leader_election.cc:288] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1e4e71221c4cee87c009b46fb7e292 (127.20.245.130:38577), e043d05e07c14858b0754a7ab12bbda9 (127.20.245.129:39415)
I20260806 13:05:53.590770 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.587642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:54969 (local address 127.20.245.129:39415)
0806 13:05:53.587694 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.587696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.587954 (+ 258us) server_negotiation.cc:407] Connection header received
0806 13:05:53.587998 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.588000 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.588020 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.588082 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:53.588256 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.588856 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.589969 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.590353 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.590416 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.590427 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.590619 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.590676 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 13:05:53.590798 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.587484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:38577 (local address 127.20.245.131:57005)
0806 13:05:53.587561 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.587578 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:53.587671 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:53.587940 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:53.587942 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:53.587945 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:53.588171 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.588173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.588915 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.588916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.589795 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.589797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.590500 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.590501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.590596 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.590601 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:53.590662 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 13:05:53.590705 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 13:05:53.590843 9033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.587624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:57005 (local address 127.20.245.130:38577)
0806 13:05:53.587684 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.587686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.587726 (+ 40us) server_negotiation.cc:407] Connection header received
0806 13:05:53.587767 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.587769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.587783 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.587852 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:53.588297 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.588831 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.589916 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.590380 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.590484 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.590495 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.590694 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.590754 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 13:05:53.590804 9043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.587489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39415 (local address 127.20.245.131:54969)
0806 13:05:53.587804 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.587816 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:53.587890 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:53.588098 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:53.588099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:53.588101 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:53.588170 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.588172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.588979 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.588979 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.589824 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:53.589826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.590447 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.590448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:53.590526 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.590531 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 13:05:53.590591 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 13:05:53.590633 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":69,"thread_start_us":167,"threads_started":1}
I20260806 13:05:53.591257 8835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e472874d0e4d44955b41359d17ee6b" candidate_uuid: "4523161dc65945fda595e523980f995d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1e4e71221c4cee87c009b46fb7e292" is_pre_election: true
I20260806 13:05:53.591255 8699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e472874d0e4d44955b41359d17ee6b" candidate_uuid: "4523161dc65945fda595e523980f995d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e043d05e07c14858b0754a7ab12bbda9" is_pre_election: true
I20260806 13:05:53.591485 8699 raft_consensus.cc:2454] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4523161dc65945fda595e523980f995d in term 0.
I20260806 13:05:53.591490 8835 raft_consensus.cc:2454] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4523161dc65945fda595e523980f995d in term 0.
I20260806 13:05:53.591791 8906 leader_election.cc:302] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4523161dc65945fda595e523980f995d, e043d05e07c14858b0754a7ab12bbda9; no voters:
I20260806 13:05:53.591948 9042 raft_consensus.cc:2781] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:05:53.592011 9042 raft_consensus.cc:482] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:05:53.592052 9042 raft_consensus.cc:3037] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:53.592988 9042 raft_consensus.cc:504] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.593367 9042 leader_election.cc:288] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [CANDIDATE]: Term 1 election: Requested vote from peers 3d1e4e71221c4cee87c009b46fb7e292 (127.20.245.130:38577), e043d05e07c14858b0754a7ab12bbda9 (127.20.245.129:39415)
I20260806 13:05:53.593590 8835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e472874d0e4d44955b41359d17ee6b" candidate_uuid: "4523161dc65945fda595e523980f995d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1e4e71221c4cee87c009b46fb7e292"
I20260806 13:05:53.593634 8699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e472874d0e4d44955b41359d17ee6b" candidate_uuid: "4523161dc65945fda595e523980f995d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e043d05e07c14858b0754a7ab12bbda9"
I20260806 13:05:53.593717 8835 raft_consensus.cc:3037] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:53.593768 8699 raft_consensus.cc:3037] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:53.594789 8835 raft_consensus.cc:2454] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4523161dc65945fda595e523980f995d in term 1.
I20260806 13:05:53.594789 8699 raft_consensus.cc:2454] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4523161dc65945fda595e523980f995d in term 1.
I20260806 13:05:53.595002 8906 leader_election.cc:302] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4523161dc65945fda595e523980f995d, e043d05e07c14858b0754a7ab12bbda9; no voters:
I20260806 13:05:53.595121 9042 raft_consensus.cc:2781] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:53.595386 9042 raft_consensus.cc:686] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 1 LEADER]: Becoming Leader. State: Replica: 4523161dc65945fda595e523980f995d, State: Running, Role: LEADER
I20260806 13:05:53.595539 9042 consensus_queue.cc:237] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } }
I20260806 13:05:53.596884 8552 catalog_manager.cc:5495] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4523161dc65945fda595e523980f995d (127.20.245.131). New cstate: current_term: 1 leader_uuid: "4523161dc65945fda595e523980f995d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523161dc65945fda595e523980f995d" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 34655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 } health_report { overall_health: UNKNOWN } } }
I20260806 13:05:53.619095 9031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.615981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36964 (local address 127.20.245.131:34655)
0806 13:05:53.616058 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.616060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.616076 (+ 16us) server_negotiation.cc:407] Connection header received
0806 13:05:53.616189 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.616190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.616216 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.616311 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:05:53.616489 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.617019 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.618013 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.618324 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.618408 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.618601 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:05:53.618751 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:05:53.618897 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.618917 (+ 20us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.618947 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:05:53.621949 8835 raft_consensus.cc:1261] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 1 FOLLOWER]: Refusing update from remote peer 4523161dc65945fda595e523980f995d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:53.621949 8699 raft_consensus.cc:1261] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [term 1 FOLLOWER]: Refusing update from remote peer 4523161dc65945fda595e523980f995d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:53.622602 9044 consensus_queue.cc:1035] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e043d05e07c14858b0754a7ab12bbda9" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 39415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:53.622792 9042 consensus_queue.cc:1035] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1e4e71221c4cee87c009b46fb7e292" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 38577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:53.626157 9047 mvcc.cc:205] Tried to move back new op lower bound from 7315544283631566848 to 7315544283528548352. Current Snapshot: MvccSnapshot[applied={T|T < 7315544283631566848}]
I20260806 13:05:53.626698 9049 mvcc.cc:205] Tried to move back new op lower bound from 7315544283631566848 to 7315544283528548352. Current Snapshot: MvccSnapshot[applied={T|T < 7315544283631566848}]
I20260806 13:05:53.627252 9048 mvcc.cc:205] Tried to move back new op lower bound from 7315544283631566848 to 7315544283528548352. Current Snapshot: MvccSnapshot[applied={T|T < 7315544283631566848}]
I20260806 13:05:53.629940 8552 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:53.630090 8552 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:53.631551 8552 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f1b0e7c126384672aae7660785271a0f: Sending DeleteTablet for 3 replicas of tablet f0e472874d0e4d44955b41359d17ee6b
I20260806 13:05:53.632130 8678 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e472874d0e4d44955b41359d17ee6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:53 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:34226
I20260806 13:05:53.632256 8815 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e472874d0e4d44955b41359d17ee6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:53 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:56690
I20260806 13:05:53.632295 8951 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e472874d0e4d44955b41359d17ee6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:53 UTC) from {username='kudu', principal='kudu/127.20.245.190@KRBTEST.COM'} at 127.0.0.1:36956
I20260806 13:05:53.632529 9058 tablet_replica.cc:330] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: stopping tablet replica
I20260806 13:05:53.632711 9058 raft_consensus.cc:2229] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:53.632859 9058 raft_consensus.cc:2258] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:53.632869 9056 tablet_replica.cc:330] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9: stopping tablet replica
I20260806 13:05:53.633008 9056 raft_consensus.cc:2229] T f0e472874d0e4d44955b41359d17ee6b P e043d05e07c14858b0754a7ab12bbda9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:53.633109 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 8616
I20260806 13:05:53.636966 9058 ts_tablet_manager.cc:1905] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:53.639530 9058 ts_tablet_manager.cc:1918] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:53.639649 9058 log.cc:1196] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/f0e472874d0e4d44955b41359d17ee6b
I20260806 13:05:53.639964 9058 ts_tablet_manager.cc:1939] T f0e472874d0e4d44955b41359d17ee6b P 3d1e4e71221c4cee87c009b46fb7e292: Deleting consensus metadata
I20260806 13:05:53.640655 9059 tablet_replica.cc:330] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: stopping tablet replica
I20260806 13:05:53.640724 8539 catalog_manager.cc:4841] TS 3d1e4e71221c4cee87c009b46fb7e292 (127.20.245.130:38577): tablet f0e472874d0e4d44955b41359d17ee6b (table test-table [id=9e616eebce2840b28bdc51b2f41ddec6]) successfully deleted
I20260806 13:05:53.640812 9059 raft_consensus.cc:2229] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:05:53.641000 9059 raft_consensus.cc:2258] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:53.641525 9059 ts_tablet_manager.cc:1905] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 13:05:53.641831 8541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:39415 (error 108)
I20260806 13:05:53.642549 9028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.642387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:39415 (local address 127.0.0.1:34232)
0806 13:05:53.642456 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:53.642500 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:39415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 13:05:53.642655 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 8751
W20260806 13:05:53.642832 8541 catalog_manager.cc:4584] TS e043d05e07c14858b0754a7ab12bbda9 (127.20.245.129:39415): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f0e472874d0e4d44955b41359d17ee6b: Network error: Client connection negotiation failed: client connection to 127.20.245.129:39415: connect: Connection refused (error 111)
I20260806 13:05:53.644189 9059 ts_tablet_manager.cc:1918] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:53.644280 9059 log.cc:1196] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/f0e472874d0e4d44955b41359d17ee6b
I20260806 13:05:53.644595 9059 ts_tablet_manager.cc:1939] T f0e472874d0e4d44955b41359d17ee6b P 4523161dc65945fda595e523980f995d: Deleting consensus metadata
I20260806 13:05:53.645447 8538 catalog_manager.cc:4841] TS 4523161dc65945fda595e523980f995d (127.20.245.131:34655): tablet f0e472874d0e4d44955b41359d17ee6b (table test-table [id=9e616eebce2840b28bdc51b2f41ddec6]) successfully deleted
I20260806 13:05:53.650784 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 8887
I20260806 13:05:53.658038 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 8522
2026-08-06T13:05:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2262 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T13:05:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:53Z Disabled control of system clock
I20260806 13:05:53.693136 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:44257
--webserver_interface=127.20.245.190
--webserver_port=0
--builtin_ntp_servers=127.20.245.148:33819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:44257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 13:05:53.793641 9064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:53.793948 9064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:53.793972 9064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:53.795353 9064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:53.795399 9064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:53.795413 9064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:53.795425 9064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:53.795439 9064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:53.796936 9064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:33819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:44257
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:44257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:53.797211 9064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:53.797524 9064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:05:53.803483 9064 server_base.cc:1034] running on GCE node
W20260806 13:05:53.803544 9072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:53.803452 9069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:53.803452 9070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:53.804111 9064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:53.804495 9064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:53.805680 9064 hybrid_clock.cc:648] HybridClock initialized: now 1786021553805662 us; error 40 us; skew 500 ppm
I20260806 13:05:53.807160 9064 webserver.cc:460] Webserver started at http://127.20.245.190:44377/ using document root <none> and password file <none>
I20260806 13:05:53.807502 9064 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:53.807574 9064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:53.807744 9064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:53.809052 9064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "aca2b08b345d4ddc910beaab81318dd8"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "260c82b34955b5ae628fc10fb2bba80c"
server_key_iv: "f0e776c53235ec36c86dede1e89e56fd"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.809481 9064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "aca2b08b345d4ddc910beaab81318dd8"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "260c82b34955b5ae628fc10fb2bba80c"
server_key_iv: "f0e776c53235ec36c86dede1e89e56fd"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.810959 9064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 13:05:53.811918 9078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:53.812105 9064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:05:53.812222 9064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "aca2b08b345d4ddc910beaab81318dd8"
format_stamp: "Formatted at 2026-08-06 13:05:53 on dist-test-slave-srgv"
server_key: "260c82b34955b5ae628fc10fb2bba80c"
server_key_iv: "f0e776c53235ec36c86dede1e89e56fd"
server_key_version: "encryptionkey@0"
I20260806 13:05:53.812312 9064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:53.827780 9064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:53.828280 9064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:53.828473 9064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:53.833783 9064 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:44257
I20260806 13:05:53.833822 9130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:44257 every 8 connection(s)
I20260806 13:05:53.834299 9064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:53.835518 9131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:53.838384 9131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8: Bootstrap starting.
I20260806 13:05:53.839073 9131 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:53.839483 9131 log.cc:824] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:53.840160 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 9064
I20260806 13:05:53.840287 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:53.840472 9131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8: No bootstrap required, opened a new log
I20260806 13:05:53.840551 21462 external_mini_cluster.cc:1428] Setting key 0c26a899637f9f8448a5eb2598918226
I20260806 13:05:53.843276 9131 raft_consensus.cc:348] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aca2b08b345d4ddc910beaab81318dd8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44257 } }
I20260806 13:05:53.843508 9131 raft_consensus.cc:374] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:53.843552 9131 raft_consensus.cc:729] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aca2b08b345d4ddc910beaab81318dd8, State: Initialized, Role: FOLLOWER
I20260806 13:05:53.843727 9131 consensus_queue.cc:260] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aca2b08b345d4ddc910beaab81318dd8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44257 } }
I20260806 13:05:53.843814 9131 raft_consensus.cc:388] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:53.843849 9131 raft_consensus.cc:482] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:53.843899 9131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:53.844726 9131 raft_consensus.cc:504] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aca2b08b345d4ddc910beaab81318dd8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44257 } }
I20260806 13:05:53.844851 9131 leader_election.cc:302] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aca2b08b345d4ddc910beaab81318dd8; no voters:
I20260806 13:05:53.845077 9131 leader_election.cc:288] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:53.845110 9136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:53.845240 9136 raft_consensus.cc:686] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [term 1 LEADER]: Becoming Leader. State: Replica: aca2b08b345d4ddc910beaab81318dd8, State: Running, Role: LEADER
I20260806 13:05:53.845333 9136 consensus_queue.cc:237] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aca2b08b345d4ddc910beaab81318dd8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44257 } }
I20260806 13:05:53.845407 9131 sys_catalog.cc:564] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:53.845707 9137 sys_catalog.cc:455] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aca2b08b345d4ddc910beaab81318dd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aca2b08b345d4ddc910beaab81318dd8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44257 } } }
I20260806 13:05:53.845970 9137 sys_catalog.cc:458] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:53.845892 9138 sys_catalog.cc:455] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aca2b08b345d4ddc910beaab81318dd8. Latest consensus state: current_term: 1 leader_uuid: "aca2b08b345d4ddc910beaab81318dd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aca2b08b345d4ddc910beaab81318dd8" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44257 } } }
I20260806 13:05:53.846251 9138 sys_catalog.cc:458] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:53.846433 9144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:53.847069 9144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:53.848564 9135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:53.841293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60324 (local address 127.20.245.190:44257)
0806 13:05:53.841581 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:53.841592 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:53.841640 (+ 48us) server_negotiation.cc:407] Connection header received
0806 13:05:53.842179 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:53.842192 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:53.842284 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:53.842467 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:53.842695 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.844753 (+ 2058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.845940 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:53.846602 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:53.846702 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:53.847593 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:53.847597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:53.847598 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:53.847884 (+ 286us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:53.847935 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:53.847961 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:53.848035 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:53.848133 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 13:05:53.848223 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":123,"threads_started":1}
I20260806 13:05:53.849282 9144 catalog_manager.cc:1347] Generated new cluster ID: 1d94e92b5873498d91d8e401335b6297
I20260806 13:05:53.849362 9144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:05:53.871513 9144 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:53.872148 9144 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:53.878525 9144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8: Generated new TSK 0
I20260806 13:05:53.878787 9144 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:05:53.886336 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.129:0
--local_ip_for_outbound_sockets=127.20.245.129
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:44257
--builtin_ntp_servers=127.20.245.148:33819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 13:05:53.987624 9155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:53.987923 9155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:53.987953 9155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:53.989600 9155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:53.989676 9155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:53.989713 9155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.129
I20260806 13:05:53.991621 9155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:33819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.245.129
--webserver_port=0
--tserver_master_addrs=127.20.245.190:44257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.129
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:53.992010 9155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:53.992442 9155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:53.999070 9161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:53.999070 9160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:53.999416 9155 server_base.cc:1034] running on GCE node
W20260806 13:05:53.999507 9163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:53.999818 9155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:54.000174 9155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:54.001386 9155 hybrid_clock.cc:648] HybridClock initialized: now 1786021554001358 us; error 47 us; skew 500 ppm
I20260806 13:05:54.003297 9155 webserver.cc:460] Webserver started at http://127.20.245.129:40823/ using document root <none> and password file <none>
I20260806 13:05:54.003635 9155 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:54.003711 9155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:54.003885 9155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:54.005484 9155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/data/instance:
uuid: "88835d077de443ef985b3ecde87e5028"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "a943363bddcb9b9c7779e468d5e36777"
server_key_iv: "deef2a4816d02a97a131bad4cc31bc7f"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.005985 9155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance:
uuid: "88835d077de443ef985b3ecde87e5028"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "a943363bddcb9b9c7779e468d5e36777"
server_key_iv: "deef2a4816d02a97a131bad4cc31bc7f"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.007763 9155 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260806 13:05:54.008797 9169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.009047 9155 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:54.009212 9155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/wal
uuid: "88835d077de443ef985b3ecde87e5028"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "a943363bddcb9b9c7779e468d5e36777"
server_key_iv: "deef2a4816d02a97a131bad4cc31bc7f"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.009315 9155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:54.020028 9155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:54.020524 9155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:54.020714 9155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:54.021029 9155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:54.021448 9155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:54.021504 9155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.021572 9155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:54.021605 9155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.028932 9155 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.129:37423
I20260806 13:05:54.029024 9283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.129:37423 every 8 connection(s)
I20260806 13:05:54.029451 9155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/data/info.pb
I20260806 13:05:54.034387 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 9155
I20260806 13:05:54.034547 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-0/wal/instance
I20260806 13:05:54.034870 21462 external_mini_cluster.cc:1428] Setting key 83691c11f7e1b1b65d53ce42ffc94d5d
I20260806 13:05:54.036240 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.130:0
--local_ip_for_outbound_sockets=127.20.245.130
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:44257
--builtin_ntp_servers=127.20.245.148:33819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 13:05:54.036543 9135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.030434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.129:34463 (local address 127.20.245.190:44257)
0806 13:05:54.030529 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.030532 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.030780 (+ 248us) server_negotiation.cc:407] Connection header received
0806 13:05:54.031517 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.031519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.031543 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.031611 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:54.032533 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.033148 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.034432 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.034739 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.034828 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.036144 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:54.036146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:54.036146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:54.036152 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:54.036173 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:54.036185 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:54.036285 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.036400 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.036438 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 13:05:54.037071 9286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.030381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:44257 (local address 127.20.245.129:34463)
0806 13:05:54.030630 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.030676 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.031362 (+ 686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.031723 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:54.031727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:54.031737 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:54.032399 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.032405 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.033300 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.033302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.034323 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.034328 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.034857 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.034858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.035048 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.035963 (+ 915us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:54.035964 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:54.036011 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:54.036045 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:54.036286 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:54.036296 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:54.036300 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:54.036674 (+ 374us) client_negotiation.cc:240] Negotiation successful
0806 13:05:54.036850 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":118,"threads_started":1}
I20260806 13:05:54.037705 9284 heartbeater.cc:347] Connected to a master server at 127.20.245.190:44257
I20260806 13:05:54.037851 9284 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:54.038142 9284 heartbeater.cc:511] Master 127.20.245.190:44257 requested a full tablet report, sending...
I20260806 13:05:54.038995 9095 ts_manager.cc:194] Registered new tserver with Master: 88835d077de443ef985b3ecde87e5028 (127.20.245.129:37423)
I20260806 13:05:54.040004 9095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.129:34463
W20260806 13:05:54.135105 9287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:54.135398 9287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:54.135424 9287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:54.136754 9287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:54.136801 9287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:54.136830 9287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.130
I20260806 13:05:54.138310 9287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:33819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.245.130
--webserver_port=0
--tserver_master_addrs=127.20.245.190:44257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.130
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:54.138623 9287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:54.138995 9287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:05:54.144946 9287 server_base.cc:1034] running on GCE node
W20260806 13:05:54.144902 9295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:54.144912 9292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:54.144914 9293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:54.145488 9287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:54.145824 9287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:54.147015 9287 hybrid_clock.cc:648] HybridClock initialized: now 1786021554147009 us; error 40 us; skew 500 ppm
I20260806 13:05:54.148685 9287 webserver.cc:460] Webserver started at http://127.20.245.130:37217/ using document root <none> and password file <none>
I20260806 13:05:54.149055 9287 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:54.149176 9287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:54.149364 9287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:54.150785 9287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/data/instance:
uuid: "0f6f2d5953284fec933936b54ea3d1de"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "21ed84651c6b31170e0d68536ed6e9fb"
server_key_iv: "b8f212fb1afc25f574c287fbc619d5da"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.151304 9287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance:
uuid: "0f6f2d5953284fec933936b54ea3d1de"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "21ed84651c6b31170e0d68536ed6e9fb"
server_key_iv: "b8f212fb1afc25f574c287fbc619d5da"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.153023 9287 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:54.154049 9301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.154279 9287 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:54.154402 9287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/wal
uuid: "0f6f2d5953284fec933936b54ea3d1de"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "21ed84651c6b31170e0d68536ed6e9fb"
server_key_iv: "b8f212fb1afc25f574c287fbc619d5da"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.154496 9287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:54.175238 9287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:54.175868 9287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:54.176038 9287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:54.176324 9287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:54.176764 9287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:54.176805 9287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.176831 9287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:54.176843 9287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.183949 9287 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.130:44215
I20260806 13:05:54.184139 9415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.130:44215 every 8 connection(s)
I20260806 13:05:54.184514 9287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/data/info.pb
I20260806 13:05:54.191043 9135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.185606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.130:38505 (local address 127.20.245.190:44257)
0806 13:05:54.185683 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.185685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.185971 (+ 286us) server_negotiation.cc:407] Connection header received
0806 13:05:54.186660 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.186662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.186679 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.186740 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:54.187570 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.188145 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.189244 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.189457 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.189551 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.190687 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:54.190689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:54.190690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:54.190697 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:54.190722 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:54.190727 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:54.190791 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.190899 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.190935 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 13:05:54.191401 9418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.185576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:44257 (local address 127.20.245.130:38505)
0806 13:05:54.185822 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.185864 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.186509 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.186825 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:54.186834 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:54.186843 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:54.187458 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.187463 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.188254 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.188255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.189135 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.189137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.189562 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.189563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.189731 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.190493 (+ 762us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:54.190494 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:54.190532 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:54.190564 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:54.190792 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:54.190800 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:54.190803 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 13:05:54.190902 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 13:05:54.191035 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":107,"threads_started":1}
I20260806 13:05:54.192230 9416 heartbeater.cc:347] Connected to a master server at 127.20.245.190:44257
I20260806 13:05:54.192349 9416 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:54.192586 9416 heartbeater.cc:511] Master 127.20.245.190:44257 requested a full tablet report, sending...
I20260806 13:05:54.193104 9095 ts_manager.cc:194] Registered new tserver with Master: 0f6f2d5953284fec933936b54ea3d1de (127.20.245.130:44215)
I20260806 13:05:54.193567 9095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.130:38505
I20260806 13:05:54.194388 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 9287
I20260806 13:05:54.194543 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/wal/instance
I20260806 13:05:54.194839 21462 external_mini_cluster.cc:1428] Setting key 0bc7ae4f36411b3d2427427944fcc3d1
I20260806 13:05:54.196054 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.245.131:0
--local_ip_for_outbound_sockets=127.20.245.131
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:44257
--builtin_ntp_servers=127.20.245.148:33819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 13:05:54.294361 9419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:54.294646 9419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:54.294675 9419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:54.296209 9419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:54.296298 9419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:54.296334 9419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.245.131
I20260806 13:05:54.298169 9419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:33819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.245.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.245.131
--webserver_port=0
--tserver_master_addrs=127.20.245.190:44257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.245.131
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:54.298543 9419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:54.298949 9419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:54.305117 9425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:54.305076 9427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:54.305100 9424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:54.305279 9419 server_base.cc:1034] running on GCE node
I20260806 13:05:54.305547 9419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:54.305905 9419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:54.307126 9419 hybrid_clock.cc:648] HybridClock initialized: now 1786021554307125 us; error 57 us; skew 500 ppm
I20260806 13:05:54.308845 9419 webserver.cc:460] Webserver started at http://127.20.245.131:42527/ using document root <none> and password file <none>
I20260806 13:05:54.309120 9419 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:54.309178 9419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:54.309337 9419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:54.310644 9419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/data/instance:
uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "ee7666043f4b4f77e9473551a6f9d00d"
server_key_iv: "d81ef99aa892410a621b8b1afd442d8d"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.311010 9419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance:
uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "ee7666043f4b4f77e9473551a6f9d00d"
server_key_iv: "d81ef99aa892410a621b8b1afd442d8d"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.312814 9419 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260806 13:05:54.313844 9433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.314056 9419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:54.314155 9419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/wal
uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa"
format_stamp: "Formatted at 2026-08-06 13:05:54 on dist-test-slave-srgv"
server_key: "ee7666043f4b4f77e9473551a6f9d00d"
server_key_iv: "d81ef99aa892410a621b8b1afd442d8d"
server_key_version: "encryptionkey@0"
I20260806 13:05:54.314237 9419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:54.349835 9419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:54.350301 9419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:54.350493 9419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:54.350801 9419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 13:05:54.351282 9419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 13:05:54.351341 9419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.351387 9419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 13:05:54.351414 9419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:54.359010 9419 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.131:35609
I20260806 13:05:54.359086 9546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.131:35609 every 8 connection(s)
I20260806 13:05:54.359548 9419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/data/info.pb
I20260806 13:05:54.363524 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 9419
I20260806 13:05:54.363659 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/wal/instance
I20260806 13:05:54.363898 21462 external_mini_cluster.cc:1428] Setting key c45c4c2e1561655dc36d1f7b8cd3fa27
I20260806 13:05:54.366217 9135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.360549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:46591 (local address 127.20.245.190:44257)
0806 13:05:54.360628 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.360630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.360892 (+ 262us) server_negotiation.cc:407] Connection header received
0806 13:05:54.361480 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.361481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.361492 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.361564 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:54.362343 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.362891 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.364492 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.364757 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.364856 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.365829 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:54.365830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:54.365831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:54.365837 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:54.365862 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:54.365867 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:54.365932 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.366036 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.366073 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 13:05:54.366453 9549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.360519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:44257 (local address 127.20.245.131:46591)
0806 13:05:54.360736 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.360785 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.361384 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.361666 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:54.361671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:54.361681 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:05:54.362264 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.362268 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.362997 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.362998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.364380 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.364384 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.364868 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.364869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.365024 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.365638 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 13:05:54.365638 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:05:54.365674 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 13:05:54.365699 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:05:54.365932 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:05:54.365940 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:05:54.365944 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:54.366039 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 13:05:54.366167 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
I20260806 13:05:54.367012 9547 heartbeater.cc:347] Connected to a master server at 127.20.245.190:44257
I20260806 13:05:54.367169 9547 heartbeater.cc:464] Registering TS with master...
I20260806 13:05:54.367453 9547 heartbeater.cc:511] Master 127.20.245.190:44257 requested a full tablet report, sending...
I20260806 13:05:54.368031 9095 ts_manager.cc:194] Registered new tserver with Master: d7916f95cd5b4d26b36aedcf92f2c1fa (127.20.245.131:35609)
I20260806 13:05:54.368724 9095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.245.131:46591
I20260806 13:05:54.376407 21462 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 13:05:54.381764 9135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.378284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60336 (local address 127.20.245.190:44257)
0806 13:05:54.378368 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.378370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.378381 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:05:54.378471 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.378472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.378490 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.378549 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:54.378749 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.379481 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.380315 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.380561 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.380646 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.381426 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:54.381428 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:54.381428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:54.381435 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:54.381454 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:54.381458 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:54.381533 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.381603 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.381637 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 13:05:54.383780 9095 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 13:05:54.385826 9095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 13:05:54.393319 9562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.388749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35590 (local address 127.20.245.130:44215)
0806 13:05:54.389018 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.389023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.389035 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:05:54.389095 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.389097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.389116 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.389592 (+ 476us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:54.389828 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.390581 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.392153 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.392842 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.392957 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.393074 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.393158 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.393200 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":121,"threads_started":1}
I20260806 13:05:54.393313 9559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.388613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:44215 (local address 127.0.0.1:35590)
0806 13:05:54.388807 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.388862 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.388941 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.389494 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:54.389495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:54.389497 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:54.389754 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.389755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.390682 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.390684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.392038 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.392041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.392957 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.392958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.393042 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.393058 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 13:05:54.393142 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 13:05:54.393199 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":175,"thread_start_us":71,"threads_started":1}
I20260806 13:05:54.393850 9564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.389117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48710 (local address 127.20.245.129:37423)
0806 13:05:54.389368 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.389372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.389381 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:05:54.389457 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.389460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.389478 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.389600 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:54.389749 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.390991 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.392152 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.392891 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.393386 (+ 495us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.393676 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.393703 (+ 27us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.393750 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":165,"threads_started":1}
I20260806 13:05:54.393337 9563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.388868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:37423 (local address 127.0.0.1:48710)
0806 13:05:54.389128 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.389140 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.389198 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.389594 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:54.389595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:54.389598 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:54.389650 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.389652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.391161 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.391162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.392036 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.392039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.392998 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.392999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.393063 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.393069 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:05:54.393113 (+ 44us) client_negotiation.cc:240] Negotiation successful
0806 13:05:54.393187 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":33,"thread_start_us":86,"threads_started":1}
I20260806 13:05:54.394238 9561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.388743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59336 (local address 127.20.245.131:35609)
0806 13:05:54.389014 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.389020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.389199 (+ 179us) server_negotiation.cc:407] Connection header received
0806 13:05:54.389355 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.389358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.389375 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.389461 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:54.389716 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.390970 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.392474 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.393269 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.393341 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.393426 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.394109 (+ 683us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.394166 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":117,"threads_started":1}
I20260806 13:05:54.394448 9560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.388618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.131:35609 (local address 127.0.0.1:59336)
0806 13:05:54.389056 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.389065 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.389247 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.389487 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:54.389490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:54.389493 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:54.389618 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.389621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.391258 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.391259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.392367 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.392370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.393770 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.393771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.393837 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.393843 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 13:05:54.393899 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 13:05:54.394383 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":3,"thread_start_us":122,"threads_started":1}
I20260806 13:05:54.394338 9350 tablet_service.cc:1467] Processing CreateTablet for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702 (DEFAULT_TABLE table=test-table [id=07cb525725084b639c298367911e0f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:54.394886 9350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:54.394784 9218 tablet_service.cc:1467] Processing CreateTablet for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702 (DEFAULT_TABLE table=test-table [id=07cb525725084b639c298367911e0f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:54.395109 9218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:54.398356 9566 tablet_bootstrap.cc:492] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Bootstrap starting.
I20260806 13:05:54.398810 9565 tablet_bootstrap.cc:492] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028: Bootstrap starting.
I20260806 13:05:54.398890 9481 tablet_service.cc:1467] Processing CreateTablet for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702 (DEFAULT_TABLE table=test-table [id=07cb525725084b639c298367911e0f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 13:05:54.399235 9566 tablet_bootstrap.cc:654] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:54.399375 9481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:54.399560 9565 tablet_bootstrap.cc:654] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:54.399619 9566 log.cc:824] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:54.399907 9565 log.cc:824] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:54.400688 9565 tablet_bootstrap.cc:492] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028: No bootstrap required, opened a new log
I20260806 13:05:54.400683 9566 tablet_bootstrap.cc:492] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: No bootstrap required, opened a new log
I20260806 13:05:54.400780 9565 ts_tablet_manager.cc:1397] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 13:05:54.400779 9566 ts_tablet_manager.cc:1397] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 13:05:54.402809 9565 raft_consensus.cc:348] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.402987 9565 raft_consensus.cc:374] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:54.403028 9565 raft_consensus.cc:729] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88835d077de443ef985b3ecde87e5028, State: Initialized, Role: FOLLOWER
I20260806 13:05:54.403173 9565 consensus_queue.cc:260] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.403523 9565 ts_tablet_manager.cc:1428] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260806 13:05:54.403731 9284 heartbeater.cc:503] Master 127.20.245.190:44257 was elected leader, sending a full tablet report...
I20260806 13:05:54.404177 9566 raft_consensus.cc:348] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.404353 9566 raft_consensus.cc:374] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:54.404388 9566 raft_consensus.cc:729] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f6f2d5953284fec933936b54ea3d1de, State: Initialized, Role: FOLLOWER
I20260806 13:05:54.404538 9566 consensus_queue.cc:260] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.404995 9570 tablet_bootstrap.cc:492] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: Bootstrap starting.
I20260806 13:05:54.405897 9570 tablet_bootstrap.cc:654] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:54.406283 9570 log.cc:824] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:54.405784 9416 heartbeater.cc:503] Master 127.20.245.190:44257 was elected leader, sending a full tablet report...
I20260806 13:05:54.405553 9566 ts_tablet_manager.cc:1428] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260806 13:05:54.408156 9570 tablet_bootstrap.cc:492] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: No bootstrap required, opened a new log
I20260806 13:05:54.408278 9570 ts_tablet_manager.cc:1397] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 13:05:54.412124 9570 raft_consensus.cc:348] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.412372 9570 raft_consensus.cc:374] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:54.412420 9570 raft_consensus.cc:729] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7916f95cd5b4d26b36aedcf92f2c1fa, State: Initialized, Role: FOLLOWER
I20260806 13:05:54.412643 9570 consensus_queue.cc:260] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.413021 9570 ts_tablet_manager.cc:1428] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260806 13:05:54.413112 9547 heartbeater.cc:503] Master 127.20.245.190:44257 was elected leader, sending a full tablet report...
W20260806 13:05:54.435339 9417 tablet.cc:2369] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:05:54.457267 9573 raft_consensus.cc:482] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 13:05:54.457450 9573 raft_consensus.cc:504] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.458091 9573 leader_election.cc:288] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f6f2d5953284fec933936b54ea3d1de (127.20.245.130:44215), 88835d077de443ef985b3ecde87e5028 (127.20.245.129:37423)
I20260806 13:05:54.461321 9564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.458461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:35393 (local address 127.20.245.129:37423)
0806 13:05:54.458561 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.458563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.458653 (+ 90us) server_negotiation.cc:407] Connection header received
0806 13:05:54.458736 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.458737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.458753 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.458799 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:54.458986 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.459548 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.460549 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.460938 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.461024 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.461035 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.461188 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.461229 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 13:05:54.461323 9562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.458427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.245.131:54049 (local address 127.20.245.130:44215)
0806 13:05:54.458522 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.458524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.458536 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:05:54.458582 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.458583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.458595 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.458679 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 13:05:54.458909 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.459496 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.460549 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.460941 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.461030 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.461038 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.461195 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.461244 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 13:05:54.461329 9549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.458298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.130:44215 (local address 127.20.245.131:54049)
0806 13:05:54.458369 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.458384 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.458445 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.458689 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:54.458690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:54.458693 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:54.458815 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.458818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.459592 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.459593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.460447 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.460449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.461028 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.461029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.461109 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.461113 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:54.461176 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 13:05:54.461229 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":42}
I20260806 13:05:54.461361 9574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.458318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:37423 (local address 127.20.245.131:35393)
0806 13:05:54.458566 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.458574 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.458665 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.458817 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:05:54.458818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:05:54.458820 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 13:05:54.458906 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.458907 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.459640 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.459641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.460449 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:05:54.460451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.461034 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.461035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:05:54.461109 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.461113 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 13:05:54.461180 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 13:05:54.461229 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":1,"thread_start_us":163,"threads_started":1}
I20260806 13:05:54.461767 9370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64e2b55eaa8d4ebeb2f1537d3bbea702" candidate_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6f2d5953284fec933936b54ea3d1de" is_pre_election: true
I20260806 13:05:54.461794 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64e2b55eaa8d4ebeb2f1537d3bbea702" candidate_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88835d077de443ef985b3ecde87e5028" is_pre_election: true
I20260806 13:05:54.461975 9370 raft_consensus.cc:2454] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7916f95cd5b4d26b36aedcf92f2c1fa in term 0.
I20260806 13:05:54.461980 9238 raft_consensus.cc:2454] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7916f95cd5b4d26b36aedcf92f2c1fa in term 0.
I20260806 13:05:54.462230 9434 leader_election.cc:302] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6f2d5953284fec933936b54ea3d1de, d7916f95cd5b4d26b36aedcf92f2c1fa; no voters:
I20260806 13:05:54.462409 9573 raft_consensus.cc:2781] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 13:05:54.462471 9573 raft_consensus.cc:482] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 13:05:54.462507 9573 raft_consensus.cc:3037] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:54.463400 9573 raft_consensus.cc:504] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.463586 9573 leader_election.cc:288] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [CANDIDATE]: Term 1 election: Requested vote from peers 0f6f2d5953284fec933936b54ea3d1de (127.20.245.130:44215), 88835d077de443ef985b3ecde87e5028 (127.20.245.129:37423)
I20260806 13:05:54.463757 9238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64e2b55eaa8d4ebeb2f1537d3bbea702" candidate_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88835d077de443ef985b3ecde87e5028"
I20260806 13:05:54.463758 9370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64e2b55eaa8d4ebeb2f1537d3bbea702" candidate_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f6f2d5953284fec933936b54ea3d1de"
I20260806 13:05:54.463863 9370 raft_consensus.cc:3037] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:54.463846 9238 raft_consensus.cc:3037] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:54.464740 9238 raft_consensus.cc:2454] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7916f95cd5b4d26b36aedcf92f2c1fa in term 1.
I20260806 13:05:54.464738 9370 raft_consensus.cc:2454] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7916f95cd5b4d26b36aedcf92f2c1fa in term 1.
I20260806 13:05:54.464948 9434 leader_election.cc:302] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f6f2d5953284fec933936b54ea3d1de, d7916f95cd5b4d26b36aedcf92f2c1fa; no voters:
I20260806 13:05:54.465046 9573 raft_consensus.cc:2781] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:54.465303 9573 raft_consensus.cc:686] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 1 LEADER]: Becoming Leader. State: Replica: d7916f95cd5b4d26b36aedcf92f2c1fa, State: Running, Role: LEADER
I20260806 13:05:54.465423 9573 consensus_queue.cc:237] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } }
I20260806 13:05:54.466439 9095 catalog_manager.cc:5495] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa reported cstate change: term changed from 0 to 1, leader changed from <none> to d7916f95cd5b4d26b36aedcf92f2c1fa (127.20.245.131). New cstate: current_term: 1 leader_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7916f95cd5b4d26b36aedcf92f2c1fa" member_type: VOTER last_known_addr { host: "127.20.245.131" port: 35609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 } health_report { overall_health: UNKNOWN } } }
I20260806 13:05:54.490350 9561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:54.487417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59338 (local address 127.20.245.131:35609)
0806 13:05:54.487499 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:54.487502 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:54.487519 (+ 17us) server_negotiation.cc:407] Connection header received
0806 13:05:54.487569 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:54.487570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:54.487597 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:54.487682 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:05:54.487977 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.488546 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.489415 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:54.489621 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:54.489698 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:54.489913 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:05:54.490049 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:05:54.490126 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:54.490215 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 13:05:54.490242 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 13:05:54.493022 9238 raft_consensus.cc:1261] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028 [term 1 FOLLOWER]: Refusing update from remote peer d7916f95cd5b4d26b36aedcf92f2c1fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:54.493023 9370 raft_consensus.cc:1261] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 1 FOLLOWER]: Refusing update from remote peer d7916f95cd5b4d26b36aedcf92f2c1fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:05:54.493527 9575 consensus_queue.cc:1035] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "88835d077de443ef985b3ecde87e5028" member_type: VOTER last_known_addr { host: "127.20.245.129" port: 37423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:54.493738 9573 consensus_queue.cc:1035] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f6f2d5953284fec933936b54ea3d1de" member_type: VOTER last_known_addr { host: "127.20.245.130" port: 44215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:05:54.498112 9580 mvcc.cc:205] Tried to move back new op lower bound from 7315544287199604736 to 7315544287091388416. Current Snapshot: MvccSnapshot[applied={T|T < 7315544287199604736 or (T in {7315544287199604736})}]
I20260806 13:05:54.501045 9095 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:54.501259 9095 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 13:05:54.502461 9095 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aca2b08b345d4ddc910beaab81318dd8: Sending DeleteTablet for 3 replicas of tablet 64e2b55eaa8d4ebeb2f1537d3bbea702
I20260806 13:05:54.502883 9350 tablet_service.cc:1514] Processing DeleteTablet for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:54 UTC) from {username='slave'} at 127.0.0.1:35590
I20260806 13:05:54.502948 9218 tablet_service.cc:1514] Processing DeleteTablet for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:54 UTC) from {username='slave'} at 127.0.0.1:48710
I20260806 13:05:54.503298 9589 tablet_replica.cc:330] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 88835d077de443ef985b3ecde87e5028: stopping tablet replica
I20260806 13:05:54.503372 9481 tablet_service.cc:1514] Processing DeleteTablet for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 13:05:54 UTC) from {username='slave'} at 127.0.0.1:59336
I20260806 13:05:54.503470 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 9155
I20260806 13:05:54.507306 9588 tablet_replica.cc:330] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: stopping tablet replica
I20260806 13:05:54.507356 9590 tablet_replica.cc:330] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: stopping tablet replica
I20260806 13:05:54.507520 9588 raft_consensus.cc:2229] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 13:05:54.507705 9588 raft_consensus.cc:2258] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:54.507700 9590 raft_consensus.cc:2229] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 1 LEADER]: Raft consensus shutting down.
I20260806 13:05:54.508054 9590 raft_consensus.cc:2258] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 13:05:54.508415 9588 ts_tablet_manager.cc:1905] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:54.508706 9590 ts_tablet_manager.cc:1905] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 13:05:54.510715 9588 ts_tablet_manager.cc:1918] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:54.510820 9588 log.cc:1196] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-1/wal/wals/64e2b55eaa8d4ebeb2f1537d3bbea702
I20260806 13:05:54.511128 9588 ts_tablet_manager.cc:1939] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P 0f6f2d5953284fec933936b54ea3d1de: Deleting consensus metadata
I20260806 13:05:54.511286 9590 ts_tablet_manager.cc:1918] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 13:05:54.511435 9590 log.cc:1196] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: Deleting WAL directory at /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786021275077601-21462-0/minicluster-data/ts-2/wal/wals/64e2b55eaa8d4ebeb2f1537d3bbea702
I20260806 13:05:54.511776 9590 ts_tablet_manager.cc:1939] T 64e2b55eaa8d4ebeb2f1537d3bbea702 P d7916f95cd5b4d26b36aedcf92f2c1fa: Deleting consensus metadata
I20260806 13:05:54.511839 9079 catalog_manager.cc:4841] TS 0f6f2d5953284fec933936b54ea3d1de (127.20.245.130:44215): tablet 64e2b55eaa8d4ebeb2f1537d3bbea702 (table test-table [id=07cb525725084b639c298367911e0f55]) successfully deleted
W20260806 13:05:54.512297 9082 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.245.129:37423 (error 108)
I20260806 13:05:54.512684 9082 catalog_manager.cc:4841] TS d7916f95cd5b4d26b36aedcf92f2c1fa (127.20.245.131:35609): tablet 64e2b55eaa8d4ebeb2f1537d3bbea702 (table test-table [id=07cb525725084b639c298367911e0f55]) successfully deleted
W20260806 13:05:54.513170 9560 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:05:54.512895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.129:37423 (local address 127.0.0.1:48720)
0806 13:05:54.512968 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0806 13:05:54.512983 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:05:54.513043 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:05:54.513096 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.129:37423: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 13:05:54.513295 9082 catalog_manager.cc:4584] TS 88835d077de443ef985b3ecde87e5028 (127.20.245.129:37423): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 64e2b55eaa8d4ebeb2f1537d3bbea702: Network error: Client connection negotiation failed: client connection to 127.20.245.129:37423: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260806 13:05:54.513644 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 9287
I20260806 13:05:54.520813 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 9419
I20260806 13:05:54.527667 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 9064
2026-08-06T13:05:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (867 ms)
[----------] 6 tests from EncryptionPolicyTest (9491 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:05:54 dist-test-slave-srgv krb5kdc[9594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:05:54 dist-test-slave-srgv krb5kdc[9594](info): set up 2 sockets
Aug 06 13:05:54 dist-test-slave-srgv krb5kdc[9594](info): commencing operation
krb5kdc: starting...
W20260806 13:05:55.636260 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:05:55 dist-test-slave-srgv krb5kdc[9594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:05:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:05:55.779593 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36197
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:55.877619 9607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:55.877912 9607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:55.877941 9607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:55.879377 9607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:55.879439 9607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:55.879454 9607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:55.879468 9607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:55.879482 9607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:55.881168 9607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36197
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:55.881436 9607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:55.881669 9607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:55.887609 9612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:55.887640 9613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:55.888032 9607 server_base.cc:1034] running on GCE node
W20260806 13:05:55.887609 9615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:55.888516 9607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:55.888918 9607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:55.890118 9607 hybrid_clock.cc:648] HybridClock initialized: now 1786021555890091 us; error 67 us; skew 500 ppm
Aug 06 13:05:55 dist-test-slave-srgv krb5kdc[9594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021555, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:55.900398 9607 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:05:55.900998 9607 webserver.cc:460] Webserver started at http://127.0.0.1:34901/ using document root <none> and password file <none>
I20260806 13:05:55.901239 9607 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:55.901298 9607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:55.901414 9607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:55.902730 9607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "08fa1e7746f641a282529d5e0a3641f7"
format_stamp: "Formatted at 2026-08-06 13:05:55 on dist-test-slave-srgv"
server_key: "4d5da9b01086efde408cf123b76d967e"
server_key_iv: "1c56cebf69562ef9524f84c7cc8d516a"
server_key_version: "encryptionkey@0"
I20260806 13:05:55.903600 9607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "08fa1e7746f641a282529d5e0a3641f7"
format_stamp: "Formatted at 2026-08-06 13:05:55 on dist-test-slave-srgv"
server_key: "4d5da9b01086efde408cf123b76d967e"
server_key_iv: "1c56cebf69562ef9524f84c7cc8d516a"
server_key_version: "encryptionkey@0"
I20260806 13:05:55.905452 9607 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:05:55.906400 9622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:55.906637 9607 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:55.906746 9607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "08fa1e7746f641a282529d5e0a3641f7"
format_stamp: "Formatted at 2026-08-06 13:05:55 on dist-test-slave-srgv"
server_key: "4d5da9b01086efde408cf123b76d967e"
server_key_iv: "1c56cebf69562ef9524f84c7cc8d516a"
server_key_version: "encryptionkey@0"
I20260806 13:05:55.906821 9607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:55.920675 9607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:55.923767 9607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:55.923924 9607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:55.929174 9607 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36197
I20260806 13:05:55.929298 9675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36197 every 8 connection(s)
I20260806 13:05:55.929718 9607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:55.930915 9676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:55.933951 9676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7: Bootstrap starting.
I20260806 13:05:55.934787 9676 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:55.935149 9676 log.cc:824] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:55.936132 9676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7: No bootstrap required, opened a new log
I20260806 13:05:55.937402 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 9607
I20260806 13:05:55.937554 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:55.937834 21462 external_mini_cluster.cc:1428] Setting key 6777839a3aacc5f46aa6db099d47bc54
I20260806 13:05:55.938700 9676 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa1e7746f641a282529d5e0a3641f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36197 } }
I20260806 13:05:55.938951 9676 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:55.939026 9676 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08fa1e7746f641a282529d5e0a3641f7, State: Initialized, Role: FOLLOWER
I20260806 13:05:55.939239 9676 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa1e7746f641a282529d5e0a3641f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36197 } }
I20260806 13:05:55.939342 9676 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:55.939388 9676 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:55.939441 9676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:55.940737 9676 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa1e7746f641a282529d5e0a3641f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36197 } }
I20260806 13:05:55.940847 9676 leader_election.cc:302] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08fa1e7746f641a282529d5e0a3641f7; no voters:
I20260806 13:05:55.941093 9676 leader_election.cc:288] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:55.941128 9681 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:55.941262 9681 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [term 1 LEADER]: Becoming Leader. State: Replica: 08fa1e7746f641a282529d5e0a3641f7, State: Running, Role: LEADER
I20260806 13:05:55.941363 9681 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa1e7746f641a282529d5e0a3641f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36197 } }
I20260806 13:05:55.941455 9676 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:55.941777 9682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08fa1e7746f641a282529d5e0a3641f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa1e7746f641a282529d5e0a3641f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36197 } } }
I20260806 13:05:55.941783 9683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08fa1e7746f641a282529d5e0a3641f7. Latest consensus state: current_term: 1 leader_uuid: "08fa1e7746f641a282529d5e0a3641f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fa1e7746f641a282529d5e0a3641f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36197 } } }
I20260806 13:05:55.942123 9682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:55.942143 9683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7 [sys.catalog]: This master's current role is: LEADER
W20260806 13:05:55.943853 9697 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:05:55.943990 9697 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:05:55.944126 9690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:55.944432 9690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:55.946807 9690 catalog_manager.cc:1347] Generated new cluster ID: 5581097b04cb41acaed8de882441a104
I20260806 13:05:55.946880 9690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:05:55 dist-test-slave-srgv krb5kdc[9594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 13:05:55.952896 9680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:55.938721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46523 (local address 127.0.0.1:36197)
0806 13:05:55.939036 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:55.939050 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:55.939109 (+ 59us) server_negotiation.cc:407] Connection header received
0806 13:05:55.939317 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:55.939325 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:55.939415 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:55.939596 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:55.940375 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:55.941674 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:55.943199 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:55.943940 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:55.944092 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:55.947882 (+ 3790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:55.947888 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:55.947888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:55.947907 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:55.950403 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:55.951025 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:55.951029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:55.951029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:55.951243 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:55.951565 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:55.951566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:55.951566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:55.951953 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:55.952140 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:55.952320 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 13:05:55.952594 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":160,"threads_started":1}
I20260806 13:05:55.954282 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:05:55.961685 9690 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:55.962543 9690 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:55.965700 9680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:55.956290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55831 (local address 127.0.0.1:36197)
0806 13:05:55.956342 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:55.956344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:55.956472 (+ 128us) server_negotiation.cc:407] Connection header received
0806 13:05:55.956525 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:55.956526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:55.956539 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:55.956607 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:55.957372 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:55.958276 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:55.959523 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:55.959912 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:55.960011 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:55.962018 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:55.962020 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:55.962020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:05:55.962030 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:55.964114 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:55.964661 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:55.964663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:55.964663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:55.964737 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:05:55.965012 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:05:55.965014 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:05:55.965014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:05:55.965199 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:55.965341 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:55.965514 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 13:05:55.965594 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 13:05:55.966687 9690 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08fa1e7746f641a282529d5e0a3641f7: Generated new TSK 0
I20260806 13:05:55.966881 9690 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:05:55.971590 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 9607
W20260806 13:05:55.977927 9592 connection.cc:535] client connection to 127.0.0.1:36197 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36197): Connection reset by peer (error 104)
2026-08-06T13:05:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:05:56 dist-test-slave-srgv krb5kdc[9707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:05:56 dist-test-slave-srgv krb5kdc[9707](info): set up 2 sockets
Aug 06 13:05:56 dist-test-slave-srgv krb5kdc[9707](info): commencing operation
krb5kdc: starting...
W20260806 13:05:57.108161 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:05:57 dist-test-slave-srgv krb5kdc[9707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:05:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:05:57.251695 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33153
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:57.370980 9720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:57.371313 9720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:57.371344 9720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:57.372689 9720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:57.372740 9720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:57.372756 9720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:57.372767 9720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:57.372781 9720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:57.374485 9720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33153
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:57.374755 9720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:57.375002 9720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:57.381049 9729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:57.381063 9726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:57.381071 9725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:57.381464 9720 server_base.cc:1034] running on GCE node
I20260806 13:05:57.381778 9720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:57.382197 9720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:57.383364 9720 hybrid_clock.cc:648] HybridClock initialized: now 1786021557383338 us; error 42 us; skew 500 ppm
Aug 06 13:05:57 dist-test-slave-srgv krb5kdc[9707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021557, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:57.386667 9720 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:05:57.387688 9720 webserver.cc:460] Webserver started at http://127.0.0.1:32921/ using document root <none> and password file <none>
I20260806 13:05:57.388128 9720 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:57.388226 9720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:57.388413 9720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:57.389812 9720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "8139e60e87124a39a71a8e94ea2b4461"
format_stamp: "Formatted at 2026-08-06 13:05:57 on dist-test-slave-srgv"
server_key: "000f7adc507247455891bba92d2ca9b2"
server_key_iv: "3363b6f2d9bb9715769cf1b8b2b722e9"
server_key_version: "encryptionkey@0"
I20260806 13:05:57.390285 9720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "8139e60e87124a39a71a8e94ea2b4461"
format_stamp: "Formatted at 2026-08-06 13:05:57 on dist-test-slave-srgv"
server_key: "000f7adc507247455891bba92d2ca9b2"
server_key_iv: "3363b6f2d9bb9715769cf1b8b2b722e9"
server_key_version: "encryptionkey@0"
I20260806 13:05:57.392179 9720 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 13:05:57.393163 9736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:57.393399 9720 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:05:57.393548 9720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "8139e60e87124a39a71a8e94ea2b4461"
format_stamp: "Formatted at 2026-08-06 13:05:57 on dist-test-slave-srgv"
server_key: "000f7adc507247455891bba92d2ca9b2"
server_key_iv: "3363b6f2d9bb9715769cf1b8b2b722e9"
server_key_version: "encryptionkey@0"
I20260806 13:05:57.393652 9720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:57.409559 9720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:57.412803 9720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:57.413026 9720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:57.418110 9720 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33153
I20260806 13:05:57.418169 9788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33153 every 8 connection(s)
I20260806 13:05:57.418628 9720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:57.419814 9789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:57.421161 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 9720
I20260806 13:05:57.421334 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:57.421613 21462 external_mini_cluster.cc:1428] Setting key 2a2550f67a586d6f72bb918307068398
I20260806 13:05:57.423892 9789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461: Bootstrap starting.
I20260806 13:05:57.424852 9789 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:57.425257 9789 log.cc:824] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:57.426220 9789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461: No bootstrap required, opened a new log
I20260806 13:05:57.428736 9789 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8139e60e87124a39a71a8e94ea2b4461" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33153 } }
I20260806 13:05:57.428954 9789 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:57.429008 9789 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8139e60e87124a39a71a8e94ea2b4461, State: Initialized, Role: FOLLOWER
I20260806 13:05:57.429222 9789 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8139e60e87124a39a71a8e94ea2b4461" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33153 } }
I20260806 13:05:57.429337 9789 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:57.429381 9789 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:57.429432 9789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:57.429703 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:57.422297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58375 (local address 127.0.0.1:33153)
0806 13:05:57.422732 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:57.422745 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:57.422791 (+ 46us) server_negotiation.cc:407] Connection header received
0806 13:05:57.423486 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:57.423498 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:57.423575 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:57.423764 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:57.424108 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:57.425911 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:57.427006 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:57.427676 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:57.427824 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:57.428772 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:57.428778 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:57.428778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:57.429046 (+ 268us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:57.429101 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:57.429121 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:57.429218 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:57.429395 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 13:05:57.429437 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":95,"threads_started":1}
I20260806 13:05:57.430305 9789 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8139e60e87124a39a71a8e94ea2b4461" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33153 } }
I20260806 13:05:57.430447 9789 leader_election.cc:302] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8139e60e87124a39a71a8e94ea2b4461; no voters:
I20260806 13:05:57.430727 9789 leader_election.cc:288] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:57.430768 9794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:57.430900 9794 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [term 1 LEADER]: Becoming Leader. State: Replica: 8139e60e87124a39a71a8e94ea2b4461, State: Running, Role: LEADER
I20260806 13:05:57.430994 9794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8139e60e87124a39a71a8e94ea2b4461" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33153 } }
I20260806 13:05:57.431069 9789 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:57.431025 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:05:57.431417 9796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8139e60e87124a39a71a8e94ea2b4461. Latest consensus state: current_term: 1 leader_uuid: "8139e60e87124a39a71a8e94ea2b4461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8139e60e87124a39a71a8e94ea2b4461" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33153 } } }
I20260806 13:05:57.431418 9795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8139e60e87124a39a71a8e94ea2b4461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8139e60e87124a39a71a8e94ea2b4461" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33153 } } }
I20260806 13:05:57.431522 9796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:57.431543 9795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461 [sys.catalog]: This master's current role is: LEADER
W20260806 13:05:57.433476 9814 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:05:57.433549 9814 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:05:57.433598 9800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:57.433789 9800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:57.435730 9800 catalog_manager.cc:1347] Generated new cluster ID: a6eb2a99026a4a51a799362e0198fb06
I20260806 13:05:57.435817 9800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:05:57.441274 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:57.433144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52961 (local address 127.0.0.1:33153)
0806 13:05:57.433181 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:57.433183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:57.433511 (+ 328us) server_negotiation.cc:407] Connection header received
0806 13:05:57.433631 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:57.433632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:57.433649 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:57.433685 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:57.433955 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:57.434580 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:57.439553 (+ 4973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:05:57.439823 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:05:57.439925 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:05:57.440923 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:57.440925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:57.440925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:57.440955 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:57.440971 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:57.440975 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:57.441047 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:57.441146 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 13:05:57.441161 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260806 13:05:57.449782 9800 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:57.450506 9800 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:57.454869 9800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8139e60e87124a39a71a8e94ea2b4461: Generated new TSK 0
I20260806 13:05:57.455111 9800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:05:57.461544 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 9720
W20260806 13:05:57.467970 9705 connection.cc:535] client connection to 127.0.0.1:33153 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33153): Connection reset by peer (error 104)
2026-08-06T13:05:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1489 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:05:57 dist-test-slave-srgv krb5kdc[9820](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:05:57 dist-test-slave-srgv krb5kdc[9820](info): set up 2 sockets
Aug 06 13:05:57 dist-test-slave-srgv krb5kdc[9820](info): commencing operation
krb5kdc: starting...
W20260806 13:05:58.527786 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:05:58 dist-test-slave-srgv krb5kdc[9820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:05:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:05:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:05:58.690851 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34063
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:05:58.796705 9833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:05:58.797063 9833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:05:58.797117 9833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:05:58.798753 9833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:05:58.798846 9833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:05:58.798873 9833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:05:58.798913 9833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:05:58.798943 9833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:05:58.801091 9833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34063
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:05:58.801525 9833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:05:58.801872 9833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:05:58.808442 9841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:58.808434 9839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:05:58.808450 9838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:05:58.808691 9833 server_base.cc:1034] running on GCE node
I20260806 13:05:58.809118 9833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:05:58.809547 9833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:05:58.810714 9833 hybrid_clock.cc:648] HybridClock initialized: now 1786021558810692 us; error 48 us; skew 500 ppm
Aug 06 13:05:58 dist-test-slave-srgv krb5kdc[9820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021558, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:05:58.814105 9833 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:05:58.814807 9833 webserver.cc:460] Webserver started at http://127.0.0.1:45685/ using document root <none> and password file <none>
I20260806 13:05:58.815119 9833 fs_manager.cc:359] Metadata directory not provided
I20260806 13:05:58.815234 9833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:05:58.815430 9833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:05:58.816951 9833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "d1ab5fa3c3064f3497e4c34809c15dcc"
format_stamp: "Formatted at 2026-08-06 13:05:58 on dist-test-slave-srgv"
server_key: "5aa921b404e542cd3270fb13c468cd98"
server_key_iv: "83979cc9c0f60a9a7463091dc8d8f3bf"
server_key_version: "encryptionkey@0"
I20260806 13:05:58.817418 9833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "d1ab5fa3c3064f3497e4c34809c15dcc"
format_stamp: "Formatted at 2026-08-06 13:05:58 on dist-test-slave-srgv"
server_key: "5aa921b404e542cd3270fb13c468cd98"
server_key_iv: "83979cc9c0f60a9a7463091dc8d8f3bf"
server_key_version: "encryptionkey@0"
I20260806 13:05:58.819260 9833 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260806 13:05:58.820318 9848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:05:58.820663 9833 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:05:58.820835 9833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "d1ab5fa3c3064f3497e4c34809c15dcc"
format_stamp: "Formatted at 2026-08-06 13:05:58 on dist-test-slave-srgv"
server_key: "5aa921b404e542cd3270fb13c468cd98"
server_key_iv: "83979cc9c0f60a9a7463091dc8d8f3bf"
server_key_version: "encryptionkey@0"
I20260806 13:05:58.820945 9833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:05:58.825623 9833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:05:58.828861 9833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:05:58.829104 9833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:05:58.835292 9833 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34063
I20260806 13:05:58.835292 9901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34063 every 8 connection(s)
I20260806 13:05:58.835968 9833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:05:58.837203 9902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:05:58.838596 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 9833
I20260806 13:05:58.838763 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:05:58.839061 21462 external_mini_cluster.cc:1428] Setting key 70830b9e2ecf68e7185ad139ee42e7b2
I20260806 13:05:58.841391 9902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc: Bootstrap starting.
I20260806 13:05:58.842497 9902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc: Neither blocks nor log segments found. Creating new log.
I20260806 13:05:58.842832 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:58.840006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51153 (local address 127.0.0.1:34063)
0806 13:05:58.840251 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:58.840262 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:58.840319 (+ 57us) server_negotiation.cc:407] Connection header received
0806 13:05:58.840915 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:58.840925 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:58.840959 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:58.841120 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:58.842154 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:58.842159 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:58.842159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:58.842164 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:58.842221 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:58.842234 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:58.842326 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:58.842401 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 13:05:58.842470 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":124,"threads_started":1}
I20260806 13:05:58.842990 9902 log.cc:824] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc: Log is configured to *not* fsync() on all Append() calls
I20260806 13:05:58.844102 9902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc: No bootstrap required, opened a new log
I20260806 13:05:58.844339 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:05:58.847772 9902 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ab5fa3c3064f3497e4c34809c15dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } }
I20260806 13:05:58.848096 9902 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:05:58.848165 9902 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1ab5fa3c3064f3497e4c34809c15dcc, State: Initialized, Role: FOLLOWER
I20260806 13:05:58.848232 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:05:58.846673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54937 (local address 127.0.0.1:34063)
0806 13:05:58.846749 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 13:05:58.846751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:05:58.846907 (+ 156us) server_negotiation.cc:407] Connection header received
0806 13:05:58.846988 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:05:58.846989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:05:58.846994 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:05:58.847045 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:05:58.847848 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:05:58.847849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:05:58.847849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:05:58.847853 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:05:58.847872 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:05:58.847876 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:05:58.847934 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 13:05:58.848024 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 13:05:58.848038 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 13:05:58.848405 9902 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ab5fa3c3064f3497e4c34809c15dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } }
I20260806 13:05:58.848541 9902 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:05:58.848590 9902 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:05:58.848652 9902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:05:58.849565 9902 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ab5fa3c3064f3497e4c34809c15dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } }
I20260806 13:05:58.849691 9902 leader_election.cc:302] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1ab5fa3c3064f3497e4c34809c15dcc; no voters:
I20260806 13:05:58.849936 9902 leader_election.cc:288] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:05:58.850056 9912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:05:58.850283 9912 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [term 1 LEADER]: Becoming Leader. State: Replica: d1ab5fa3c3064f3497e4c34809c15dcc, State: Running, Role: LEADER
I20260806 13:05:58.850313 9902 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:05:58.850404 9912 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ab5fa3c3064f3497e4c34809c15dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } }
I20260806 13:05:58.850981 9914 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1ab5fa3c3064f3497e4c34809c15dcc. Latest consensus state: current_term: 1 leader_uuid: "d1ab5fa3c3064f3497e4c34809c15dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ab5fa3c3064f3497e4c34809c15dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } } }
I20260806 13:05:58.851143 9914 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [sys.catalog]: This master's current role is: LEADER
I20260806 13:05:58.850965 9913 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1ab5fa3c3064f3497e4c34809c15dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ab5fa3c3064f3497e4c34809c15dcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34063 } } }
I20260806 13:05:58.851502 9913 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc [sys.catalog]: This master's current role is: LEADER
W20260806 13:05:58.852778 9928 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:05:58.852830 9928 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:05:58.852907 9921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:05:58.853134 9921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:05:58.854887 9921 catalog_manager.cc:1347] Generated new cluster ID: c466b50b91f64c72b23ab20f5f189beb
I20260806 13:05:58.854954 9921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:05:58.862977 9921 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:05:58.863372 9921 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:05:58.869110 9921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1ab5fa3c3064f3497e4c34809c15dcc: Generated new TSK 0
I20260806 13:05:58.869375 9921 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:05:58.874814 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 9833
2026-08-06T13:05:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1413 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:05:58 dist-test-slave-srgv krb5kdc[9933](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:05:58 dist-test-slave-srgv krb5kdc[9933](info): set up 2 sockets
Aug 06 13:05:58 dist-test-slave-srgv krb5kdc[9933](info): commencing operation
krb5kdc: starting...
W20260806 13:05:59.959945 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:00 dist-test-slave-srgv krb5kdc[9933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:00.118872 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38091
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:00.222321 9946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:00.222636 9946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:00.222667 9946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:00.224362 9946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:00.224452 9946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:00.224467 9946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:00.224483 9946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:00.224496 9946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:00.226903 9946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:00.227370 9946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:00.227701 9946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:00.234228 9952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:00.234344 9954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:00.234303 9951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:00.234511 9946 server_base.cc:1034] running on GCE node
I20260806 13:06:00.234906 9946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:00.235349 9946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:00.236541 9946 hybrid_clock.cc:648] HybridClock initialized: now 1786021560236524 us; error 52 us; skew 500 ppm
Aug 06 13:06:00 dist-test-slave-srgv krb5kdc[9933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021560, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:00.239961 9946 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:00.240641 9946 webserver.cc:460] Webserver started at http://127.0.0.1:45093/ using document root <none> and password file <none>
I20260806 13:06:00.240958 9946 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:00.241041 9946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:00.241217 9946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:00.242655 9946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "8592d2a7a31e404ea82942b4b2266f1c"
format_stamp: "Formatted at 2026-08-06 13:06:00 on dist-test-slave-srgv"
server_key: "561a2a9859664ceb9dc164357b9c0b6e"
server_key_iv: "fc4cacb26731c3f6f071236912bb11c4"
server_key_version: "encryptionkey@0"
I20260806 13:06:00.243150 9946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "8592d2a7a31e404ea82942b4b2266f1c"
format_stamp: "Formatted at 2026-08-06 13:06:00 on dist-test-slave-srgv"
server_key: "561a2a9859664ceb9dc164357b9c0b6e"
server_key_iv: "fc4cacb26731c3f6f071236912bb11c4"
server_key_version: "encryptionkey@0"
I20260806 13:06:00.245384 9946 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:06:00.246382 9961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:00.246656 9946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:00.246825 9946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "8592d2a7a31e404ea82942b4b2266f1c"
format_stamp: "Formatted at 2026-08-06 13:06:00 on dist-test-slave-srgv"
server_key: "561a2a9859664ceb9dc164357b9c0b6e"
server_key_iv: "fc4cacb26731c3f6f071236912bb11c4"
server_key_version: "encryptionkey@0"
I20260806 13:06:00.246927 9946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:00.267802 9946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:00.270707 9946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:00.270922 9946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:00.276139 9946 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38091
I20260806 13:06:00.276182 10014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38091 every 8 connection(s)
I20260806 13:06:00.276647 9946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:00.277783 10015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:00.280699 10015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c: Bootstrap starting.
I20260806 13:06:00.281476 10015 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:00.281848 10015 log.cc:824] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:00.282966 10015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c: No bootstrap required, opened a new log
I20260806 13:06:00.285039 10015 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8592d2a7a31e404ea82942b4b2266f1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } }
I20260806 13:06:00.285256 10015 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:00.285285 10015 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8592d2a7a31e404ea82942b4b2266f1c, State: Initialized, Role: FOLLOWER
I20260806 13:06:00.285498 10015 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8592d2a7a31e404ea82942b4b2266f1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } }
I20260806 13:06:00.285583 10015 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:00.285609 10015 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:00.285682 10015 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:00.286547 10015 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8592d2a7a31e404ea82942b4b2266f1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } }
I20260806 13:06:00.286732 10015 leader_election.cc:302] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8592d2a7a31e404ea82942b4b2266f1c; no voters:
I20260806 13:06:00.286854 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 9946
I20260806 13:06:00.286991 10015 leader_election.cc:288] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:00.286996 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:00.287158 10018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:00.287294 21462 external_mini_cluster.cc:1428] Setting key 7c3000b2734c66c1b7eb4e1f51b62144
I20260806 13:06:00.287392 10018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [term 1 LEADER]: Becoming Leader. State: Replica: 8592d2a7a31e404ea82942b4b2266f1c, State: Running, Role: LEADER
I20260806 13:06:00.287401 10015 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:00.287519 10018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8592d2a7a31e404ea82942b4b2266f1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } }
I20260806 13:06:00.287986 10019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8592d2a7a31e404ea82942b4b2266f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8592d2a7a31e404ea82942b4b2266f1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } } }
I20260806 13:06:00.287966 10018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8592d2a7a31e404ea82942b4b2266f1c. Latest consensus state: current_term: 1 leader_uuid: "8592d2a7a31e404ea82942b4b2266f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8592d2a7a31e404ea82942b4b2266f1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } } }
I20260806 13:06:00.288141 10018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:00.288131 10019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:00.289196 10024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:00.289882 10024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:00.291965 10024 catalog_manager.cc:1347] Generated new cluster ID: cd06ca7b88d64a0594a1c77d684c8cb5
I20260806 13:06:00.292029 10024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:06:00 dist-test-slave-srgv krb5kdc[9933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 13:06:00.301182 10023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:00.288185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53737 (local address 127.0.0.1:38091)
0806 13:06:00.288698 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:00.288713 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:00.288761 (+ 48us) server_negotiation.cc:407] Connection header received
0806 13:06:00.288939 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:00.288951 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:00.289028 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:00.289216 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:00.290472 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:00.291868 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:00.292826 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:00.293306 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:00.293434 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:00.296520 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:00.296527 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:00.296527 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:00.296544 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:00.299237 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:00.299671 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:00.299674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:00.299675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:00.299789 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:00.300024 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:00.300025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:00.300026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:00.300353 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:00.300566 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:00.300644 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 13:06:00.300815 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":111,"threads_started":1}
I20260806 13:06:00.302312 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:00.310470 10024 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:00.311332 10024 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:00.314356 10024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8592d2a7a31e404ea82942b4b2266f1c: Generated new TSK 0
I20260806 13:06:00.314589 10024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:00.318678 10023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:00.304112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46637 (local address 127.0.0.1:38091)
0806 13:06:00.304171 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:00.304173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:00.307529 (+ 3356us) server_negotiation.cc:407] Connection header received
0806 13:06:00.307666 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:00.307667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:00.307687 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:00.307771 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:00.308452 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:00.309124 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:00.309959 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:00.310306 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:00.310395 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:00.315586 (+ 5191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:00.315588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:00.315589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:00.315599 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:00.317332 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:00.317726 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:00.317727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:00.317728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:00.317797 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:00.317988 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:00.317989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:00.317989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:00.318153 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:00.318291 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:00.318433 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 13:06:00.318561 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":33}
I20260806 13:06:00.321517 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 9946
2026-08-06T13:06:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1446 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:00 dist-test-slave-srgv krb5kdc[10046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:00 dist-test-slave-srgv krb5kdc[10046](info): set up 2 sockets
Aug 06 13:06:00 dist-test-slave-srgv krb5kdc[10046](info): commencing operation
krb5kdc: starting...
W20260806 13:06:01.475823 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:01 dist-test-slave-srgv krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:01.624722 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42897
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:01.726776 10059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:01.727152 10059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:01.727200 10059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:01.728693 10059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:01.728785 10059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:01.728813 10059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:01.728845 10059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:01.728895 10059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:01.730770 10059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:01.731141 10059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:01.731491 10059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:01.737838 10064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:01.738073 10067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:01.737849 10065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:01.737983 10059 server_base.cc:1034] running on GCE node
I20260806 13:06:01.738432 10059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:01.738830 10059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:01.739991 10059 hybrid_clock.cc:648] HybridClock initialized: now 1786021561739925 us; error 82 us; skew 500 ppm
Aug 06 13:06:01 dist-test-slave-srgv krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021561, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:01.750734 10059 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:01.751554 10059 webserver.cc:460] Webserver started at http://127.0.0.1:40729/ using document root <none> and password file <none>
I20260806 13:06:01.751830 10059 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:01.751881 10059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:01.752004 10059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:01.753438 10059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "22e29e436b8747d2a004cc711c86c1d7"
format_stamp: "Formatted at 2026-08-06 13:06:01 on dist-test-slave-srgv"
server_key: "5a417b85c8d8e368e88c78fbc587066f"
server_key_iv: "4a05aa03a2595c0ff7c5ad793ffbfbb5"
server_key_version: "encryptionkey@0"
I20260806 13:06:01.753819 10059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "22e29e436b8747d2a004cc711c86c1d7"
format_stamp: "Formatted at 2026-08-06 13:06:01 on dist-test-slave-srgv"
server_key: "5a417b85c8d8e368e88c78fbc587066f"
server_key_iv: "4a05aa03a2595c0ff7c5ad793ffbfbb5"
server_key_version: "encryptionkey@0"
I20260806 13:06:01.755899 10059 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 13:06:01.756847 10074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:01.757107 10059 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:01.757247 10059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "22e29e436b8747d2a004cc711c86c1d7"
format_stamp: "Formatted at 2026-08-06 13:06:01 on dist-test-slave-srgv"
server_key: "5a417b85c8d8e368e88c78fbc587066f"
server_key_iv: "4a05aa03a2595c0ff7c5ad793ffbfbb5"
server_key_version: "encryptionkey@0"
I20260806 13:06:01.757342 10059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:01.768491 10059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:01.771080 10059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:01.771339 10059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:01.777019 10059 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42897
I20260806 13:06:01.777062 10126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42897 every 8 connection(s)
I20260806 13:06:01.777542 10059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:01.778685 10127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:01.781581 10127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7: Bootstrap starting.
I20260806 13:06:01.782325 10127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:01.782698 10127 log.cc:824] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:01.782845 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10059
I20260806 13:06:01.783015 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:01.783277 21462 external_mini_cluster.cc:1428] Setting key 706b51afe2f2c942c2a652d1efad2c45
I20260806 13:06:01.783751 10127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7: No bootstrap required, opened a new log
I20260806 13:06:01.787099 10127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e29e436b8747d2a004cc711c86c1d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } }
I20260806 13:06:01.787375 10127 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:01.787416 10127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e29e436b8747d2a004cc711c86c1d7, State: Initialized, Role: FOLLOWER
I20260806 13:06:01.787572 10127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e29e436b8747d2a004cc711c86c1d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } }
I20260806 13:06:01.787673 10127 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:01.787724 10127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:01.787779 10127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:01.788612 10127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e29e436b8747d2a004cc711c86c1d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } }
I20260806 13:06:01.788738 10127 leader_election.cc:302] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22e29e436b8747d2a004cc711c86c1d7; no voters:
I20260806 13:06:01.788939 10127 leader_election.cc:288] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:01.789048 10132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:01.789275 10127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:01.789332 10132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [term 1 LEADER]: Becoming Leader. State: Replica: 22e29e436b8747d2a004cc711c86c1d7, State: Running, Role: LEADER
I20260806 13:06:01.789556 10132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e29e436b8747d2a004cc711c86c1d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } }
I20260806 13:06:01.789971 10132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e29e436b8747d2a004cc711c86c1d7. Latest consensus state: current_term: 1 leader_uuid: "22e29e436b8747d2a004cc711c86c1d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e29e436b8747d2a004cc711c86c1d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } } }
I20260806 13:06:01.790023 10134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22e29e436b8747d2a004cc711c86c1d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e29e436b8747d2a004cc711c86c1d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } } }
I20260806 13:06:01.790129 10134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:01.790328 10132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:01.790692 10141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:01.791621 10141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:01.791625 10131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:01.783995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55855 (local address 127.0.0.1:42897)
0806 13:06:01.784219 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:01.784231 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:01.784280 (+ 49us) server_negotiation.cc:407] Connection header received
0806 13:06:01.785348 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:01.785361 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:01.785440 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:01.785642 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:01.785888 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:01.787462 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:01.788488 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:01.789195 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:01.789354 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:01.790326 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:01.790331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:01.790331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:01.790628 (+ 297us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:01.790683 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:01.790706 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:01.791060 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:01.791096 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 13:06:01.791338 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":109,"threads_started":1}
I20260806 13:06:01.792794 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:01.795244 10141 catalog_manager.cc:1347] Generated new cluster ID: 3ee624844b854809890f70cb7ac184c5
I20260806 13:06:01.795321 10141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:01.801482 10141 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:01.802332 10141 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:01.805236 10131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:01.794642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43967 (local address 127.0.0.1:42897)
0806 13:06:01.794684 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:01.794687 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:01.801250 (+ 6563us) server_negotiation.cc:407] Connection header received
0806 13:06:01.801389 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:01.801390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:01.801407 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:01.801490 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:01.801723 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:01.802497 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:01.803673 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:01.803998 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:01.804066 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:01.804919 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:01.804920 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:01.804921 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:01.804928 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:01.804948 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:01.804953 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:01.805004 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:01.805080 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 13:06:01.805140 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 13:06:01.812136 10141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22e29e436b8747d2a004cc711c86c1d7: Generated new TSK 0
I20260806 13:06:01.812424 10141 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:01.817570 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10059
2026-08-06T13:06:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:01 dist-test-slave-srgv krb5kdc[10159](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:01 dist-test-slave-srgv krb5kdc[10159](info): set up 2 sockets
Aug 06 13:06:01 dist-test-slave-srgv krb5kdc[10159](info): commencing operation
krb5kdc: starting...
W20260806 13:06:02.968917 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:03 dist-test-slave-srgv krb5kdc[10159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:03.122676 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44693
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:03.221168 10172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:03.221611 10172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:03.221657 10172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:03.223150 10172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:03.223251 10172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:03.223280 10172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:03.223311 10172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:03.223351 10172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:03.225096 10172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:03.225432 10172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:03.225728 10172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:03.231808 10180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:03.231817 10177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:03.231812 10178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:03.232188 10172 server_base.cc:1034] running on GCE node
I20260806 13:06:03.232473 10172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:03.232836 10172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:03.234299 10172 hybrid_clock.cc:648] HybridClock initialized: now 1786021563234191 us; error 125 us; skew 500 ppm
Aug 06 13:06:03 dist-test-slave-srgv krb5kdc[10159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021563, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:03.237888 10172 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:03.238667 10172 webserver.cc:460] Webserver started at http://127.0.0.1:38469/ using document root <none> and password file <none>
I20260806 13:06:03.238981 10172 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:03.239061 10172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:03.239283 10172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:03.240682 10172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "5e320979c5d64b8597b62cbdd1e50325"
format_stamp: "Formatted at 2026-08-06 13:06:03 on dist-test-slave-srgv"
server_key: "d2490166dbab6b1424e8b6ce11d82e84"
server_key_iv: "97af6a92ab1b0a8614e7e1d3f11401fa"
server_key_version: "encryptionkey@0"
I20260806 13:06:03.241139 10172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "5e320979c5d64b8597b62cbdd1e50325"
format_stamp: "Formatted at 2026-08-06 13:06:03 on dist-test-slave-srgv"
server_key: "d2490166dbab6b1424e8b6ce11d82e84"
server_key_iv: "97af6a92ab1b0a8614e7e1d3f11401fa"
server_key_version: "encryptionkey@0"
I20260806 13:06:03.242877 10172 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:06:03.244042 10187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:03.244319 10172 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:03.244448 10172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "5e320979c5d64b8597b62cbdd1e50325"
format_stamp: "Formatted at 2026-08-06 13:06:03 on dist-test-slave-srgv"
server_key: "d2490166dbab6b1424e8b6ce11d82e84"
server_key_iv: "97af6a92ab1b0a8614e7e1d3f11401fa"
server_key_version: "encryptionkey@0"
I20260806 13:06:03.244541 10172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:03.248765 10172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:03.251767 10172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:03.251967 10172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:03.258028 10172 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44693
I20260806 13:06:03.258062 10239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44693 every 8 connection(s)
I20260806 13:06:03.258551 10172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:03.259928 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10172
I20260806 13:06:03.260082 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:03.260301 10240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:03.260350 21462 external_mini_cluster.cc:1428] Setting key f8632b4cf181413e0ec29ce43bf204ae
I20260806 13:06:03.263386 10243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:03.261053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59199 (local address 127.0.0.1:44693)
0806 13:06:03.261283 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:03.261292 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:03.261324 (+ 32us) server_negotiation.cc:407] Connection header received
0806 13:06:03.261779 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:03.261787 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:03.261816 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:03.261955 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:03.262782 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:03.262785 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:03.262786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:03.262790 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:03.262836 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:03.262848 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:03.262906 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:03.263003 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 13:06:03.263066 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":112,"threads_started":1}
I20260806 13:06:03.264719 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:03.265107 10240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325: Bootstrap starting.
I20260806 13:06:03.266080 10240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:03.266575 10240 log.cc:824] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:03.267701 10240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325: No bootstrap required, opened a new log
I20260806 13:06:03.268710 10243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:03.267097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52075 (local address 127.0.0.1:44693)
0806 13:06:03.267206 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:03.267208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:03.267366 (+ 158us) server_negotiation.cc:407] Connection header received
0806 13:06:03.267426 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:03.267427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:03.267435 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:03.267514 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:03.268452 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:03.268454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:03.268454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:03.268459 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:03.268480 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:03.268485 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:03.268558 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:03.268619 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 13:06:03.268635 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 13:06:03.270491 10240 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e320979c5d64b8597b62cbdd1e50325" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44693 } }
I20260806 13:06:03.270780 10240 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:03.270836 10240 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e320979c5d64b8597b62cbdd1e50325, State: Initialized, Role: FOLLOWER
I20260806 13:06:03.271000 10240 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e320979c5d64b8597b62cbdd1e50325" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44693 } }
I20260806 13:06:03.271095 10240 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:03.271124 10240 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:03.271162 10240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:03.272035 10240 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e320979c5d64b8597b62cbdd1e50325" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44693 } }
I20260806 13:06:03.272152 10240 leader_election.cc:302] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e320979c5d64b8597b62cbdd1e50325; no voters:
I20260806 13:06:03.272395 10240 leader_election.cc:288] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:03.272531 10250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:03.272718 10250 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [term 1 LEADER]: Becoming Leader. State: Replica: 5e320979c5d64b8597b62cbdd1e50325, State: Running, Role: LEADER
I20260806 13:06:03.272782 10240 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:03.272827 10250 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e320979c5d64b8597b62cbdd1e50325" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44693 } }
I20260806 13:06:03.273435 10251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e320979c5d64b8597b62cbdd1e50325" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e320979c5d64b8597b62cbdd1e50325" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44693 } } }
I20260806 13:06:03.273574 10251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:03.273862 10258 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:03.274072 10252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e320979c5d64b8597b62cbdd1e50325. Latest consensus state: current_term: 1 leader_uuid: "5e320979c5d64b8597b62cbdd1e50325" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e320979c5d64b8597b62cbdd1e50325" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44693 } } }
I20260806 13:06:03.274227 10252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:03.274654 10258 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:03.276703 10258 catalog_manager.cc:1347] Generated new cluster ID: 9e9ab37d77024cb98027fb84caa590e6
I20260806 13:06:03.276767 10258 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:03.287444 10258 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:03.287703 10258 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:03.291255 10258 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e320979c5d64b8597b62cbdd1e50325: Generated new TSK 0
I20260806 13:06:03.291510 10258 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:03.296634 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10172
2026-08-06T13:06:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:03 dist-test-slave-srgv krb5kdc[10271](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:03 dist-test-slave-srgv krb5kdc[10271](info): set up 2 sockets
Aug 06 13:06:03 dist-test-slave-srgv krb5kdc[10271](info): commencing operation
krb5kdc: starting...
W20260806 13:06:04.387998 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:04 dist-test-slave-srgv krb5kdc[10271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:04.540184 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46697
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:04.645614 10284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:04.646013 10284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:04.646078 10284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:04.647879 10284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:04.647989 10284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:04.648016 10284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:04.648041 10284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:04.648084 10284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:04.650274 10284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46697
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:04.650736 10284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:04.651101 10284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:04.657897 10289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:04.657912 10290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:04.657912 10292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:04.658533 10284 server_base.cc:1034] running on GCE node
I20260806 13:06:04.659049 10284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:04.659570 10284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:04.660796 10284 hybrid_clock.cc:648] HybridClock initialized: now 1786021564660794 us; error 52 us; skew 500 ppm
Aug 06 13:06:04 dist-test-slave-srgv krb5kdc[10271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021564, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:04.664417 10284 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:04.665136 10284 webserver.cc:460] Webserver started at http://127.0.0.1:43445/ using document root <none> and password file <none>
I20260806 13:06:04.665450 10284 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:04.665531 10284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:04.665726 10284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:04.667125 10284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "61c180f1364645e5b7c93aa2b0b86b73"
format_stamp: "Formatted at 2026-08-06 13:06:04 on dist-test-slave-srgv"
server_key: "d053510570aed71ba4c98c594c9a03b8"
server_key_iv: "5768699f4587b01c0095609ebcbab674"
server_key_version: "encryptionkey@0"
I20260806 13:06:04.667706 10284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "61c180f1364645e5b7c93aa2b0b86b73"
format_stamp: "Formatted at 2026-08-06 13:06:04 on dist-test-slave-srgv"
server_key: "d053510570aed71ba4c98c594c9a03b8"
server_key_iv: "5768699f4587b01c0095609ebcbab674"
server_key_version: "encryptionkey@0"
I20260806 13:06:04.669647 10284 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:06:04.670925 10299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:04.671345 10284 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:04.671489 10284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "61c180f1364645e5b7c93aa2b0b86b73"
format_stamp: "Formatted at 2026-08-06 13:06:04 on dist-test-slave-srgv"
server_key: "d053510570aed71ba4c98c594c9a03b8"
server_key_iv: "5768699f4587b01c0095609ebcbab674"
server_key_version: "encryptionkey@0"
I20260806 13:06:04.671602 10284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:04.696801 10284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:04.700109 10284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:04.700354 10284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:04.710078 10284 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46697
I20260806 13:06:04.710237 10351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46697 every 8 connection(s)
I20260806 13:06:04.711069 10284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:04.713227 10352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:04.717470 10352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73: Bootstrap starting.
I20260806 13:06:04.718277 10352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:04.718647 10352 log.cc:824] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:04.718658 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10284
I20260806 13:06:04.718817 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:04.719122 21462 external_mini_cluster.cc:1428] Setting key fa797b2f5a84fd318ee3a67366b02992
I20260806 13:06:04.719882 10352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73: No bootstrap required, opened a new log
I20260806 13:06:04.723011 10352 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61c180f1364645e5b7c93aa2b0b86b73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46697 } }
I20260806 13:06:04.723418 10352 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:04.723485 10352 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c180f1364645e5b7c93aa2b0b86b73, State: Initialized, Role: FOLLOWER
I20260806 13:06:04.723763 10352 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61c180f1364645e5b7c93aa2b0b86b73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46697 } }
I20260806 13:06:04.723941 10352 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:04.724027 10352 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:04.724144 10352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:04.726109 10352 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61c180f1364645e5b7c93aa2b0b86b73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46697 } }
I20260806 13:06:04.726429 10352 leader_election.cc:302] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61c180f1364645e5b7c93aa2b0b86b73; no voters:
I20260806 13:06:04.726939 10352 leader_election.cc:288] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:04.727041 10357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:04.727473 10357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [term 1 LEADER]: Becoming Leader. State: Replica: 61c180f1364645e5b7c93aa2b0b86b73, State: Running, Role: LEADER
I20260806 13:06:04.727564 10352 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:04.727984 10357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61c180f1364645e5b7c93aa2b0b86b73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46697 } }
I20260806 13:06:04.729640 10359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61c180f1364645e5b7c93aa2b0b86b73. Latest consensus state: current_term: 1 leader_uuid: "61c180f1364645e5b7c93aa2b0b86b73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61c180f1364645e5b7c93aa2b0b86b73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46697 } } }
I20260806 13:06:04.730072 10359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:04.730852 10358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61c180f1364645e5b7c93aa2b0b86b73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61c180f1364645e5b7c93aa2b0b86b73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46697 } } }
I20260806 13:06:04.730973 10358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:04.731720 10366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:04.733530 10366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:04.737218 10366 catalog_manager.cc:1347] Generated new cluster ID: bf00030990074420a7ede2fe27be2bfa
I20260806 13:06:04.737310 10366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:06:04 dist-test-slave-srgv krb5kdc[10271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 13:06:04.751917 10356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:04.719897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:56459 (local address 127.0.0.1:46697)
0806 13:06:04.720128 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:04.720139 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:04.720234 (+ 95us) server_negotiation.cc:407] Connection header received
0806 13:06:04.721568 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:04.721593 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:04.721737 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:04.722050 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:04.723480 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:04.727343 (+ 3863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:04.730694 (+ 3351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:04.732538 (+ 1844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:04.732786 (+ 248us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:04.738636 (+ 5850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:04.738641 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:04.738642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:04.738658 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:04.743525 (+ 4867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:04.745672 (+ 2147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:04.745680 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:04.745680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:04.746257 (+ 577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:04.747500 (+ 1243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:04.747501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:04.747501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:04.748611 (+ 1110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:04.749350 (+ 739us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:04.750423 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0806 13:06:04.750881 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":157,"thread_start_us":112,"threads_started":1}
I20260806 13:06:04.754597 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:04.775210 10366 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:04.776193 10366 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:04.779452 10356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:04.760628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:37697 (local address 127.0.0.1:46697)
0806 13:06:04.760849 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:04.760871 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:04.760904 (+ 33us) server_negotiation.cc:407] Connection header received
0806 13:06:04.761047 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:04.761049 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:04.761076 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:04.761407 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:04.765006 (+ 3599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:04.766975 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:04.770323 (+ 3348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:04.770977 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:04.771122 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:04.775881 (+ 4759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:04.775884 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:04.775885 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:04.775897 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:04.777874 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:04.778422 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:04.778424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:04.778425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:04.778487 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:04.778737 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:04.778738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:04.778738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:04.778874 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:04.778966 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:04.779257 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 13:06:04.779338 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 13:06:04.785686 10366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61c180f1364645e5b7c93aa2b0b86b73: Generated new TSK 0
I20260806 13:06:04.786016 10366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:04.793427 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10284
W20260806 13:06:04.800272 10269 connection.cc:535] client connection to 127.0.0.1:46697 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46697): Connection reset by peer (error 104)
2026-08-06T13:06:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:04 dist-test-slave-srgv krb5kdc[10383](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:04 dist-test-slave-srgv krb5kdc[10383](info): set up 2 sockets
Aug 06 13:06:04 dist-test-slave-srgv krb5kdc[10383](info): commencing operation
krb5kdc: starting...
W20260806 13:06:05.927748 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:06 dist-test-slave-srgv krb5kdc[10383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:06.079762 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37577
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37577
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:06.179697 10396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:06.180483 10396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:06.180621 10396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:06.185555 10396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:06.185948 10396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:06.186021 10396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:06.186074 10396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:06.186160 10396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:06.190191 10396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37577
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:06.190697 10396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:06.191017 10396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:06.202750 10401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:06.202754 10402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:06.202800 10396 server_base.cc:1034] running on GCE node
W20260806 13:06:06.202792 10404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:06.203464 10396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:06.203895 10396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:06.205091 10396 hybrid_clock.cc:648] HybridClock initialized: now 1786021566205085 us; error 94 us; skew 500 ppm
Aug 06 13:06:06 dist-test-slave-srgv krb5kdc[10383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021566, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:06.209007 10396 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:06.209707 10396 webserver.cc:460] Webserver started at http://127.0.0.1:42337/ using document root <none> and password file <none>
I20260806 13:06:06.210033 10396 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:06.210145 10396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:06.210332 10396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:06.211797 10396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "b431f51acd554087ac345d2a452a3d7c"
format_stamp: "Formatted at 2026-08-06 13:06:06 on dist-test-slave-srgv"
server_key: "ccc517f0e20387cde2eed3b22685b46d"
server_key_iv: "ec22845c30fb0cfc5f16857f7742dd45"
server_key_version: "encryptionkey@0"
I20260806 13:06:06.212244 10396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "b431f51acd554087ac345d2a452a3d7c"
format_stamp: "Formatted at 2026-08-06 13:06:06 on dist-test-slave-srgv"
server_key: "ccc517f0e20387cde2eed3b22685b46d"
server_key_iv: "ec22845c30fb0cfc5f16857f7742dd45"
server_key_version: "encryptionkey@0"
I20260806 13:06:06.214126 10396 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260806 13:06:06.215154 10411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:06.215504 10396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:06.215643 10396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "b431f51acd554087ac345d2a452a3d7c"
format_stamp: "Formatted at 2026-08-06 13:06:06 on dist-test-slave-srgv"
server_key: "ccc517f0e20387cde2eed3b22685b46d"
server_key_iv: "ec22845c30fb0cfc5f16857f7742dd45"
server_key_version: "encryptionkey@0"
I20260806 13:06:06.215749 10396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:06.232323 10396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:06.235493 10396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:06.235924 10396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:06.248453 10396 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37577
I20260806 13:06:06.248582 10463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37577 every 8 connection(s)
I20260806 13:06:06.249866 10396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:06.254837 10464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:06.259017 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10396
I20260806 13:06:06.259573 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:06.260576 21462 external_mini_cluster.cc:1428] Setting key e6ef3ddac829ade7c8c4f9980caf9e47
I20260806 13:06:06.265828 10464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c: Bootstrap starting.
I20260806 13:06:06.266858 10464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:06.267354 10464 log.cc:824] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:06.268463 10464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c: No bootstrap required, opened a new log
I20260806 13:06:06.270752 10467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:06.262304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:35989 (local address 127.0.0.1:37577)
0806 13:06:06.262991 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:06.263037 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:06.263321 (+ 284us) server_negotiation.cc:407] Connection header received
0806 13:06:06.264462 (+ 1141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:06.264474 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:06.264574 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:06.264763 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:06.265215 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:06.266441 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:06.267840 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:06.268454 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:06.268567 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:06.269610 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:06.269616 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:06.269616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:06.269872 (+ 256us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:06.269919 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:06.269935 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:06.270016 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:06.270409 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 13:06:06.270460 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":375,"threads_started":1}
I20260806 13:06:06.271596 10464 raft_consensus.cc:348] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b431f51acd554087ac345d2a452a3d7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37577 } }
I20260806 13:06:06.271893 10464 raft_consensus.cc:374] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:06.271979 10464 raft_consensus.cc:729] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b431f51acd554087ac345d2a452a3d7c, State: Initialized, Role: FOLLOWER
I20260806 13:06:06.272141 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:06.272161 10464 consensus_queue.cc:260] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b431f51acd554087ac345d2a452a3d7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37577 } }
I20260806 13:06:06.272260 10464 raft_consensus.cc:388] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:06.272306 10464 raft_consensus.cc:482] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:06.272361 10464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:06.273497 10464 raft_consensus.cc:504] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b431f51acd554087ac345d2a452a3d7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37577 } }
I20260806 13:06:06.273713 10464 leader_election.cc:302] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b431f51acd554087ac345d2a452a3d7c; no voters:
I20260806 13:06:06.273926 10464 leader_election.cc:288] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:06.273977 10473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:06.274180 10473 raft_consensus.cc:686] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [term 1 LEADER]: Becoming Leader. State: Replica: b431f51acd554087ac345d2a452a3d7c, State: Running, Role: LEADER
I20260806 13:06:06.274267 10464 sys_catalog.cc:564] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:06.274443 10473 consensus_queue.cc:237] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b431f51acd554087ac345d2a452a3d7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37577 } }
I20260806 13:06:06.275025 10474 sys_catalog.cc:455] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b431f51acd554087ac345d2a452a3d7c. Latest consensus state: current_term: 1 leader_uuid: "b431f51acd554087ac345d2a452a3d7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b431f51acd554087ac345d2a452a3d7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37577 } } }
I20260806 13:06:06.275146 10474 sys_catalog.cc:458] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:06.275434 10475 sys_catalog.cc:455] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b431f51acd554087ac345d2a452a3d7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b431f51acd554087ac345d2a452a3d7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37577 } } }
I20260806 13:06:06.275552 10475 sys_catalog.cc:458] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:06.275779 10483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:06.276489 10483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:06.278888 10467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:06.274172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:36353 (local address 127.0.0.1:37577)
0806 13:06:06.274224 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:06.274227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:06.274712 (+ 485us) server_negotiation.cc:407] Connection header received
0806 13:06:06.274803 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:06.274804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:06.274820 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:06.274913 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:06.275152 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:06.275994 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:06.276884 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:06.277472 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:06.277579 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:06.278485 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:06.278487 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:06.278487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:06.278494 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:06.278516 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:06.278521 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:06.278602 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:06.278781 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 13:06:06.278797 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 13:06:06.279548 10483 catalog_manager.cc:1347] Generated new cluster ID: d295e68729e14e808529e62a9ee47add
I20260806 13:06:06.279609 10483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:06.306018 10483 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:06.306952 10483 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:06.317945 10483 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b431f51acd554087ac345d2a452a3d7c: Generated new TSK 0
I20260806 13:06:06.318338 10483 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:06.322144 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10396
W20260806 13:06:06.328881 10381 connection.cc:535] client connection to 127.0.0.1:37577 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37577): Connection reset by peer (error 104)
2026-08-06T13:06:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1528 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:06 dist-test-slave-srgv krb5kdc[10495](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:06 dist-test-slave-srgv krb5kdc[10495](info): set up 2 sockets
Aug 06 13:06:06 dist-test-slave-srgv krb5kdc[10495](info): commencing operation
krb5kdc: starting...
W20260806 13:06:07.466770 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:07 dist-test-slave-srgv krb5kdc[10495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:07.618846 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43847
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:07.716144 10508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:07.716477 10508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:07.716523 10508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:07.717880 10508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:07.717972 10508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:07.717998 10508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:07.718019 10508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:07.718051 10508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:07.719815 10508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:07.720175 10508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:07.720475 10508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:07.726256 10513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:07.726293 10516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:07.726256 10514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:07.726806 10508 server_base.cc:1034] running on GCE node
I20260806 13:06:07.727041 10508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:07.727515 10508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:07.728688 10508 hybrid_clock.cc:648] HybridClock initialized: now 1786021567728677 us; error 38 us; skew 500 ppm
Aug 06 13:06:07 dist-test-slave-srgv krb5kdc[10495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021567, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:07.731760 10508 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:07.732295 10508 webserver.cc:460] Webserver started at http://127.0.0.1:35261/ using document root <none> and password file <none>
I20260806 13:06:07.732539 10508 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:07.732584 10508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:07.732715 10508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:07.733985 10508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "9e7e6401096543aeadf5bde09032a687"
format_stamp: "Formatted at 2026-08-06 13:06:07 on dist-test-slave-srgv"
server_key: "63f3aac6505e9a34689f995298adbf20"
server_key_iv: "eb60eafc801ca903cce45535e48d2d71"
server_key_version: "encryptionkey@0"
I20260806 13:06:07.734350 10508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "9e7e6401096543aeadf5bde09032a687"
format_stamp: "Formatted at 2026-08-06 13:06:07 on dist-test-slave-srgv"
server_key: "63f3aac6505e9a34689f995298adbf20"
server_key_iv: "eb60eafc801ca903cce45535e48d2d71"
server_key_version: "encryptionkey@0"
I20260806 13:06:07.736167 10508 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:06:07.737166 10523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:07.737489 10508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:07.737589 10508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "9e7e6401096543aeadf5bde09032a687"
format_stamp: "Formatted at 2026-08-06 13:06:07 on dist-test-slave-srgv"
server_key: "63f3aac6505e9a34689f995298adbf20"
server_key_iv: "eb60eafc801ca903cce45535e48d2d71"
server_key_version: "encryptionkey@0"
I20260806 13:06:07.737687 10508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:07.741876 10508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:07.744841 10508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:07.744998 10508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:07.750313 10508 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43847
I20260806 13:06:07.750737 10575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43847 every 8 connection(s)
I20260806 13:06:07.750803 10508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:07.751825 10576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:07.754786 10576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687: Bootstrap starting.
I20260806 13:06:07.755648 10576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:07.756048 10576 log.cc:824] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:07.756598 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10508
I20260806 13:06:07.756796 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:07.757059 21462 external_mini_cluster.cc:1428] Setting key 49d980ec7a74b01e42b5b378b287950a
I20260806 13:06:07.757264 10576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687: No bootstrap required, opened a new log
I20260806 13:06:07.759739 10576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e7e6401096543aeadf5bde09032a687" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43847 } }
I20260806 13:06:07.759984 10576 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:07.760030 10576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7e6401096543aeadf5bde09032a687, State: Initialized, Role: FOLLOWER
I20260806 13:06:07.760269 10576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e7e6401096543aeadf5bde09032a687" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43847 } }
I20260806 13:06:07.760874 10576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:07.760957 10576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:07.761049 10576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:07.761639 10580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:07.757834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:51547 (local address 127.0.0.1:43847)
0806 13:06:07.758083 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:07.758095 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:07.758133 (+ 38us) server_negotiation.cc:407] Connection header received
0806 13:06:07.759709 (+ 1576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:07.759722 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:07.759762 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:07.759932 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:07.760926 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:07.760930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:07.760931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:07.760935 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:07.761028 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:07.761045 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:07.761188 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:07.761285 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 13:06:07.761348 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":131,"threads_started":1}
I20260806 13:06:07.762025 10576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e7e6401096543aeadf5bde09032a687" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43847 } }
I20260806 13:06:07.762171 10576 leader_election.cc:302] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e7e6401096543aeadf5bde09032a687; no voters:
I20260806 13:06:07.762422 10576 leader_election.cc:288] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:07.762465 10581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:07.762657 10581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [term 1 LEADER]: Becoming Leader. State: Replica: 9e7e6401096543aeadf5bde09032a687, State: Running, Role: LEADER
I20260806 13:06:07.762794 10576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:07.762792 10581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e7e6401096543aeadf5bde09032a687" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43847 } }
I20260806 13:06:07.763520 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:07.764101 10582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e7e6401096543aeadf5bde09032a687" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e7e6401096543aeadf5bde09032a687" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43847 } } }
I20260806 13:06:07.764343 10582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:07.764500 10583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e7e6401096543aeadf5bde09032a687. Latest consensus state: current_term: 1 leader_uuid: "9e7e6401096543aeadf5bde09032a687" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e7e6401096543aeadf5bde09032a687" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43847 } } }
I20260806 13:06:07.764668 10583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:07.764820 10592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:07.765712 10592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:07.767314 10580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:07.765933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:56021 (local address 127.0.0.1:43847)
0806 13:06:07.765978 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:07.765980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:07.765992 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:06:07.766072 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:07.766073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:07.766095 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:07.766159 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:07.766955 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:07.766957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:07.766957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:07.766962 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:07.766982 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:07.766987 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:07.767043 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:07.767224 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 13:06:07.767243 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 13:06:07.768179 10592 catalog_manager.cc:1347] Generated new cluster ID: deb39fd2ba634e4cbba4e43dcc812a8f
I20260806 13:06:07.768249 10592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:07.781279 10592 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:07.781584 10592 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:07.783875 10592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e7e6401096543aeadf5bde09032a687: Generated new TSK 0
I20260806 13:06:07.784089 10592 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:07.789620 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10508
2026-08-06T13:06:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1467 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:07 dist-test-slave-srgv krb5kdc[10607](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:07 dist-test-slave-srgv krb5kdc[10607](info): set up 2 sockets
Aug 06 13:06:07 dist-test-slave-srgv krb5kdc[10607](info): commencing operation
krb5kdc: starting...
W20260806 13:06:08.866717 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:08 dist-test-slave-srgv krb5kdc[10607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:09.030871 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36317
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:09.140928 10620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:09.141259 10620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:09.141296 10620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:09.142886 10620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:09.142953 10620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:09.142968 10620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:09.142982 10620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:09.142994 10620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:09.144915 10620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36317
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:09.145217 10620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:09.145460 10620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:09.151741 10628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:09.151978 10620 server_base.cc:1034] running on GCE node
W20260806 13:06:09.151741 10626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:09.151768 10625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:09.152495 10620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:09.152918 10620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:09.154157 10620 hybrid_clock.cc:648] HybridClock initialized: now 1786021569154152 us; error 83 us; skew 500 ppm
Aug 06 13:06:09 dist-test-slave-srgv krb5kdc[10607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021569, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:09.158006 10620 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:09.158766 10620 webserver.cc:460] Webserver started at http://127.0.0.1:45981/ using document root <none> and password file <none>
I20260806 13:06:09.159103 10620 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:09.159219 10620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:09.159417 10620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:09.160799 10620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "15e1409ae6d246e29a021e9ddca68e15"
format_stamp: "Formatted at 2026-08-06 13:06:09 on dist-test-slave-srgv"
server_key: "e2ee484e9ecee4be7badf1dfdba62da0"
server_key_iv: "65412a6313dbbd226bafb7e8a3b43c99"
server_key_version: "encryptionkey@0"
I20260806 13:06:09.161260 10620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "15e1409ae6d246e29a021e9ddca68e15"
format_stamp: "Formatted at 2026-08-06 13:06:09 on dist-test-slave-srgv"
server_key: "e2ee484e9ecee4be7badf1dfdba62da0"
server_key_iv: "65412a6313dbbd226bafb7e8a3b43c99"
server_key_version: "encryptionkey@0"
I20260806 13:06:09.162984 10620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 13:06:09.164083 10635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:09.164316 10620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:09.164453 10620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "15e1409ae6d246e29a021e9ddca68e15"
format_stamp: "Formatted at 2026-08-06 13:06:09 on dist-test-slave-srgv"
server_key: "e2ee484e9ecee4be7badf1dfdba62da0"
server_key_iv: "65412a6313dbbd226bafb7e8a3b43c99"
server_key_version: "encryptionkey@0"
I20260806 13:06:09.164547 10620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:09.180253 10620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:09.183568 10620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:09.183800 10620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:09.190083 10620 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36317
I20260806 13:06:09.190177 10687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36317 every 8 connection(s)
I20260806 13:06:09.190685 10620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:09.192068 10688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:09.195500 10688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15: Bootstrap starting.
I20260806 13:06:09.196381 10688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:09.196753 10688 log.cc:824] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:09.197814 10688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15: No bootstrap required, opened a new log
I20260806 13:06:09.199441 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10620
I20260806 13:06:09.199615 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:09.199939 21462 external_mini_cluster.cc:1428] Setting key c8c46264b4e4ce945187dbf5f18c078a
I20260806 13:06:09.200285 10688 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1409ae6d246e29a021e9ddca68e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } }
I20260806 13:06:09.200506 10688 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:09.200577 10688 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e1409ae6d246e29a021e9ddca68e15, State: Initialized, Role: FOLLOWER
I20260806 13:06:09.200747 10688 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1409ae6d246e29a021e9ddca68e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } }
I20260806 13:06:09.200912 10688 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:09.200980 10688 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:09.201052 10688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:09.202225 10688 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1409ae6d246e29a021e9ddca68e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } }
I20260806 13:06:09.202387 10688 leader_election.cc:302] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15e1409ae6d246e29a021e9ddca68e15; no voters:
I20260806 13:06:09.202612 10688 leader_election.cc:288] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:09.202658 10693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:09.202842 10693 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [term 1 LEADER]: Becoming Leader. State: Replica: 15e1409ae6d246e29a021e9ddca68e15, State: Running, Role: LEADER
I20260806 13:06:09.202979 10688 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:09.203001 10693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1409ae6d246e29a021e9ddca68e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } }
I20260806 13:06:09.203521 10693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15e1409ae6d246e29a021e9ddca68e15. Latest consensus state: current_term: 1 leader_uuid: "15e1409ae6d246e29a021e9ddca68e15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1409ae6d246e29a021e9ddca68e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } } }
I20260806 13:06:09.203528 10695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15e1409ae6d246e29a021e9ddca68e15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1409ae6d246e29a021e9ddca68e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36317 } } }
I20260806 13:06:09.203732 10693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:09.203738 10695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:09.204291 10703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:09.205036 10703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:09.207413 10703 catalog_manager.cc:1347] Generated new cluster ID: 8abba5e75b9544849f26c56b6a4a0e7f
I20260806 13:06:09.207479 10703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:06:09 dist-test-slave-srgv krb5kdc[10607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 13:06:09.213898 10703 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:09.214475 10703 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:09.215436 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:09.200817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:33899 (local address 127.0.0.1:36317)
0806 13:06:09.201126 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:09.201142 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:09.201182 (+ 40us) server_negotiation.cc:407] Connection header received
0806 13:06:09.201315 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:09.201322 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:09.201380 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:09.201549 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:09.202330 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:09.203864 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:09.205138 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:09.205799 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:09.205924 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:09.209819 (+ 3895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:09.209825 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:09.209826 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:09.209843 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:09.212788 (+ 2945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:09.213417 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:09.213421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:09.213421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:09.213551 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:09.213856 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:09.213858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:09.213858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:09.214241 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:09.214437 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:09.214992 (+ 555us) server_negotiation.cc:299] Negotiation successful
0806 13:06:09.215117 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":125,"threads_started":1}
I20260806 13:06:09.216755 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:09.226119 10703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15e1409ae6d246e29a021e9ddca68e15: Generated new TSK 0
I20260806 13:06:09.226397 10703 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:09.228001 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:09.218699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:52899 (local address 127.0.0.1:36317)
0806 13:06:09.218745 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:09.218747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:09.218909 (+ 162us) server_negotiation.cc:407] Connection header received
0806 13:06:09.218972 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:09.218973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:09.218987 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:09.219046 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:09.219823 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:09.220782 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:09.221967 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:09.222384 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:09.222486 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:09.224301 (+ 1815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:09.224303 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:09.224303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:09.224313 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:09.226288 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:09.226938 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:09.226948 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:09.226948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:09.227030 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:09.227418 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:09.227419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:09.227419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:09.227550 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:09.227651 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:09.227855 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 13:06:09.227922 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 13:06:09.231711 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10620
W20260806 13:06:09.238638 10605 connection.cc:535] client connection to 127.0.0.1:36317 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36317): Connection reset by peer (error 104)
2026-08-06T13:06:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1442 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:09 dist-test-slave-srgv krb5kdc[10720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:09 dist-test-slave-srgv krb5kdc[10720](info): set up 2 sockets
Aug 06 13:06:09 dist-test-slave-srgv krb5kdc[10720](info): commencing operation
krb5kdc: starting...
W20260806 13:06:10.354803 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:10 dist-test-slave-srgv krb5kdc[10720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:10.506850 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43255
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:10.606110 10734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:10.606549 10734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:10.606691 10734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:10.608408 10734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:10.608503 10734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:10.608527 10734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:10.608549 10734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:10.608582 10734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:10.610530 10734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43255
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:10.610914 10734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:10.611289 10734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:10.617359 10742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:10.617364 10739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:10.617359 10740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:10.617594 10734 server_base.cc:1034] running on GCE node
I20260806 13:06:10.618010 10734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:10.618397 10734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:10.619593 10734 hybrid_clock.cc:648] HybridClock initialized: now 1786021570619566 us; error 43 us; skew 500 ppm
Aug 06 13:06:10 dist-test-slave-srgv krb5kdc[10720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021570, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:10.622836 10734 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:10.623591 10734 webserver.cc:460] Webserver started at http://127.0.0.1:43473/ using document root <none> and password file <none>
I20260806 13:06:10.623904 10734 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:10.623980 10734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:10.624163 10734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:10.625553 10734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "e1945bb581644733a64fd075818eb040"
format_stamp: "Formatted at 2026-08-06 13:06:10 on dist-test-slave-srgv"
server_key: "569bbe4e1805228e3171bfcb00701b78"
server_key_iv: "1c0efbb30e90a7751cd345f0b4abf047"
server_key_version: "encryptionkey@0"
I20260806 13:06:10.626096 10734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "e1945bb581644733a64fd075818eb040"
format_stamp: "Formatted at 2026-08-06 13:06:10 on dist-test-slave-srgv"
server_key: "569bbe4e1805228e3171bfcb00701b78"
server_key_iv: "1c0efbb30e90a7751cd345f0b4abf047"
server_key_version: "encryptionkey@0"
I20260806 13:06:10.628577 10734 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 13:06:10.629803 10749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:10.630052 10734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:10.630187 10734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "e1945bb581644733a64fd075818eb040"
format_stamp: "Formatted at 2026-08-06 13:06:10 on dist-test-slave-srgv"
server_key: "569bbe4e1805228e3171bfcb00701b78"
server_key_iv: "1c0efbb30e90a7751cd345f0b4abf047"
server_key_version: "encryptionkey@0"
I20260806 13:06:10.630307 10734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:10.645421 10734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:10.648223 10734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:10.648379 10734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:10.654422 10734 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43255
I20260806 13:06:10.654500 10802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43255 every 8 connection(s)
I20260806 13:06:10.654976 10734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:10.656211 10803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:10.659543 10803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040: Bootstrap starting.
I20260806 13:06:10.660359 10803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:10.660714 10803 log.cc:824] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:10.661777 10803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040: No bootstrap required, opened a new log
I20260806 13:06:10.664116 10803 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1945bb581644733a64fd075818eb040" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43255 } }
I20260806 13:06:10.664336 10803 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:10.664366 10803 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1945bb581644733a64fd075818eb040, State: Initialized, Role: FOLLOWER
I20260806 13:06:10.664604 10803 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1945bb581644733a64fd075818eb040" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43255 } }
I20260806 13:06:10.664721 10803 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:10.664774 10803 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:10.664865 10803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:10.664896 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10734
I20260806 13:06:10.665064 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:10.665395 21462 external_mini_cluster.cc:1428] Setting key 7cb19464322f08a41b5b95e12a5a3152
I20260806 13:06:10.665998 10803 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1945bb581644733a64fd075818eb040" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43255 } }
I20260806 13:06:10.666159 10803 leader_election.cc:302] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1945bb581644733a64fd075818eb040; no voters:
I20260806 13:06:10.666400 10803 leader_election.cc:288] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:10.666437 10807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:10.666679 10807 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [term 1 LEADER]: Becoming Leader. State: Replica: e1945bb581644733a64fd075818eb040, State: Running, Role: LEADER
I20260806 13:06:10.666795 10807 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1945bb581644733a64fd075818eb040" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43255 } }
I20260806 13:06:10.666839 10803 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:10.667747 10809 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1945bb581644733a64fd075818eb040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1945bb581644733a64fd075818eb040" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43255 } } }
I20260806 13:06:10.668318 10809 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:10.668184 10810 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1945bb581644733a64fd075818eb040. Latest consensus state: current_term: 1 leader_uuid: "e1945bb581644733a64fd075818eb040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1945bb581644733a64fd075818eb040" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43255 } } }
I20260806 13:06:10.668473 10810 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:10.668742 10822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:10.669552 10822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:10.671528 10822 catalog_manager.cc:1347] Generated new cluster ID: b85e79c3449c40d484c33536105d9ba7
I20260806 13:06:10.671597 10822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:10.673655 10808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:10.666211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:39255 (local address 127.0.0.1:43255)
0806 13:06:10.666578 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:10.666595 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:10.666673 (+ 78us) server_negotiation.cc:407] Connection header received
0806 13:06:10.666864 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:10.666873 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:10.666996 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:10.667204 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:10.667501 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:10.669295 (+ 1794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:10.670820 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:10.671569 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:10.672164 (+ 595us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:10.672732 (+ 568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:10.672737 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:10.672738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:10.673006 (+ 268us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:10.673054 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:10.673072 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:10.673172 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:10.673339 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 13:06:10.673380 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":138,"threads_started":1}
I20260806 13:06:10.675083 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:10.682723 10808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:10.677198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:41901 (local address 127.0.0.1:43255)
0806 13:06:10.677249 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:10.677252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:10.677396 (+ 144us) server_negotiation.cc:407] Connection header received
0806 13:06:10.677452 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:10.677454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:10.677468 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:10.677543 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:10.677747 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:10.679553 (+ 1806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:10.680824 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:10.681249 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:10.681344 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:10.682351 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:10.682353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:10.682353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:10.682362 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:10.682387 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:10.682392 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:10.682468 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:10.682567 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 13:06:10.682585 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 13:06:10.683864 10822 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:10.684530 10822 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:10.696092 10822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1945bb581644733a64fd075818eb040: Generated new TSK 0
I20260806 13:06:10.696458 10822 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:10.699536 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10734
W20260806 13:06:10.706158 10718 connection.cc:535] client connection to 127.0.0.1:43255 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43255): Connection reset by peer (error 104)
2026-08-06T13:06:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1466 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:10 dist-test-slave-srgv krb5kdc[10834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:10 dist-test-slave-srgv krb5kdc[10834](info): set up 2 sockets
Aug 06 13:06:10 dist-test-slave-srgv krb5kdc[10834](info): commencing operation
krb5kdc: starting...
W20260806 13:06:11.821978 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:11 dist-test-slave-srgv krb5kdc[10834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 13:06:11.984807 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46233
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:12.092445 10847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:12.092772 10847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:12.092854 10847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:12.094440 10847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:12.094499 10847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:12.094514 10847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:12.094528 10847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:12.094542 10847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:12.096357 10847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46233
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:12.096697 10847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:12.096992 10847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:12.103402 10852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:12.103416 10855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:12.103425 10853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:12.103847 10847 server_base.cc:1034] running on GCE node
I20260806 13:06:12.104180 10847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:12.104539 10847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:12.105723 10847 hybrid_clock.cc:648] HybridClock initialized: now 1786021572105698 us; error 46 us; skew 500 ppm
Aug 06 13:06:12 dist-test-slave-srgv krb5kdc[10834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021572, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:12.109344 10847 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 13:06:12.109952 10847 webserver.cc:460] Webserver started at http://127.0.0.1:39929/ using document root <none> and password file <none>
I20260806 13:06:12.110229 10847 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:12.110281 10847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:12.110433 10847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:12.111869 10847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "65294400c0fc4f23885e45ee506733cd"
format_stamp: "Formatted at 2026-08-06 13:06:12 on dist-test-slave-srgv"
server_key: "846a68286bf45808c5d0e8af97fefa0b"
server_key_iv: "a4d9090349f8dda1251c0d138df2fce7"
server_key_version: "encryptionkey@0"
I20260806 13:06:12.112309 10847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "65294400c0fc4f23885e45ee506733cd"
format_stamp: "Formatted at 2026-08-06 13:06:12 on dist-test-slave-srgv"
server_key: "846a68286bf45808c5d0e8af97fefa0b"
server_key_iv: "a4d9090349f8dda1251c0d138df2fce7"
server_key_version: "encryptionkey@0"
I20260806 13:06:12.114008 10847 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 13:06:12.115036 10862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:12.115317 10847 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:12.115434 10847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "65294400c0fc4f23885e45ee506733cd"
format_stamp: "Formatted at 2026-08-06 13:06:12 on dist-test-slave-srgv"
server_key: "846a68286bf45808c5d0e8af97fefa0b"
server_key_iv: "a4d9090349f8dda1251c0d138df2fce7"
server_key_version: "encryptionkey@0"
I20260806 13:06:12.115525 10847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:12.119570 10847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:12.122424 10847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:12.122603 10847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:12.127854 10847 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46233
I20260806 13:06:12.127949 10915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46233 every 8 connection(s)
I20260806 13:06:12.128341 10847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:12.129676 10916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:12.132750 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10847
I20260806 13:06:12.132910 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:12.133162 10916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd: Bootstrap starting.
I20260806 13:06:12.133196 21462 external_mini_cluster.cc:1428] Setting key ae40420241de7222effac285bdd4d021
I20260806 13:06:12.134140 10916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:12.134646 10916 log.cc:824] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:12.135910 10916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd: No bootstrap required, opened a new log
I20260806 13:06:12.136953 10919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:12.133936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:34583 (local address 127.0.0.1:46233)
0806 13:06:12.134238 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:12.134248 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:12.134331 (+ 83us) server_negotiation.cc:407] Connection header received
0806 13:06:12.135223 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:12.135236 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:12.135279 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:12.135497 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:12.136437 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:12.136441 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:12.136441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:12.136446 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:12.136495 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:12.136508 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:12.136593 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:12.136714 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 13:06:12.136764 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":151,"threads_started":1}
I20260806 13:06:12.138265 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:12.138906 10916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65294400c0fc4f23885e45ee506733cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46233 } }
I20260806 13:06:12.139304 10916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:12.139384 10916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65294400c0fc4f23885e45ee506733cd, State: Initialized, Role: FOLLOWER
I20260806 13:06:12.139581 10916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65294400c0fc4f23885e45ee506733cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46233 } }
I20260806 13:06:12.139740 10916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:12.139832 10916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:12.139925 10916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:12.141093 10916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65294400c0fc4f23885e45ee506733cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46233 } }
I20260806 13:06:12.141276 10916 leader_election.cc:302] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65294400c0fc4f23885e45ee506733cd; no voters:
I20260806 13:06:12.141561 10916 leader_election.cc:288] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:12.141692 10926 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:12.142056 10919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:12.140519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.240:42599 (local address 127.0.0.1:46233)
0806 13:06:12.140576 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:12.140579 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:12.140690 (+ 111us) server_negotiation.cc:407] Connection header received
0806 13:06:12.140783 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:12.140784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:12.140789 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:12.140838 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:12.141719 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:12.141721 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:12.141722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:12.141728 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:12.141749 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:12.141755 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:12.141810 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:12.141964 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 13:06:12.141979 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 13:06:12.141956 10916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:12.142369 10926 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [term 1 LEADER]: Becoming Leader. State: Replica: 65294400c0fc4f23885e45ee506733cd, State: Running, Role: LEADER
I20260806 13:06:12.142822 10926 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65294400c0fc4f23885e45ee506733cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46233 } }
I20260806 13:06:12.143364 10928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65294400c0fc4f23885e45ee506733cd. Latest consensus state: current_term: 1 leader_uuid: "65294400c0fc4f23885e45ee506733cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65294400c0fc4f23885e45ee506733cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46233 } } }
I20260806 13:06:12.143553 10928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:12.143603 10927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65294400c0fc4f23885e45ee506733cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65294400c0fc4f23885e45ee506733cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46233 } } }
I20260806 13:06:12.143769 10927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd [sys.catalog]: This master's current role is: LEADER
W20260806 13:06:12.144373 10940 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:12.144423 10940 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:12.144491 10941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:12.144740 10941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:12.148821 10941 catalog_manager.cc:1347] Generated new cluster ID: 3dc2417c86934f6cbeaa3f467bc98e7a
I20260806 13:06:12.148909 10941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:12.156462 10941 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:12.156733 10941 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:12.169804 10941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65294400c0fc4f23885e45ee506733cd: Generated new TSK 0
I20260806 13:06:12.170171 10941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:12.174532 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10847
2026-08-06T13:06:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1474 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:12 dist-test-slave-srgv krb5kdc[10947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:12 dist-test-slave-srgv krb5kdc[10947](info): set up 2 sockets
Aug 06 13:06:12 dist-test-slave-srgv krb5kdc[10947](info): commencing operation
krb5kdc: starting...
W20260806 13:06:13.324199 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:13 dist-test-slave-srgv krb5kdc[10947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:06:13.476222 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35155
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:45915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:35155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:13.578339 10960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:13.578696 10960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:13.578739 10960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:13.580199 10960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:13.580292 10960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:13.580317 10960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:13.580340 10960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:13.580379 10960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:13.582222 10960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:45915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:35155
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:13.582595 10960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:13.582904 10960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:13.588802 10965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:13.588735 10968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:13.588884 10966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:13.589354 10960 server_base.cc:1034] running on GCE node
I20260806 13:06:13.589672 10960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:13.590042 10960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:13.591429 10960 hybrid_clock.cc:648] HybridClock initialized: now 1786021573591393 us; error 70 us; skew 500 ppm
Aug 06 13:06:13 dist-test-slave-srgv krb5kdc[10947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021573, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:13.601361 10960 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:06:13.601999 10960 webserver.cc:460] Webserver started at http://127.20.245.190:35407/ using document root <none> and password file <none>
I20260806 13:06:13.602320 10960 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:13.602382 10960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:13.602566 10960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:13.604234 10960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "39493b9d114c4dbcbd3f055168df5262"
format_stamp: "Formatted at 2026-08-06 13:06:13 on dist-test-slave-srgv"
server_key: "0ee03c16a44cfc8d1f283a64ded97df4"
server_key_iv: "528473933afc804952ea1ea2cc3484b7"
server_key_version: "encryptionkey@0"
I20260806 13:06:13.604758 10960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "39493b9d114c4dbcbd3f055168df5262"
format_stamp: "Formatted at 2026-08-06 13:06:13 on dist-test-slave-srgv"
server_key: "0ee03c16a44cfc8d1f283a64ded97df4"
server_key_iv: "528473933afc804952ea1ea2cc3484b7"
server_key_version: "encryptionkey@0"
I20260806 13:06:13.606678 10960 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260806 13:06:13.607853 10975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:13.608090 10960 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 13:06:13.608218 10960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "39493b9d114c4dbcbd3f055168df5262"
format_stamp: "Formatted at 2026-08-06 13:06:13 on dist-test-slave-srgv"
server_key: "0ee03c16a44cfc8d1f283a64ded97df4"
server_key_iv: "528473933afc804952ea1ea2cc3484b7"
server_key_version: "encryptionkey@0"
I20260806 13:06:13.608318 10960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:13.620930 10960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:13.624028 10960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:13.624240 10960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:13.629576 10960 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:35155
I20260806 13:06:13.629616 11028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:35155 every 8 connection(s)
I20260806 13:06:13.630152 10960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:13.631542 11029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:13.633991 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 10960
I20260806 13:06:13.634267 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:13.634509 21462 external_mini_cluster.cc:1428] Setting key 24ca163c8e66d6a73502104ef4f357de
I20260806 13:06:13.635090 11029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262: Bootstrap starting.
I20260806 13:06:13.636056 11029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:13.636526 11029 log.cc:824] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:13.637539 11029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262: No bootstrap required, opened a new log
I20260806 13:06:13.640381 11029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39493b9d114c4dbcbd3f055168df5262" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35155 } }
I20260806 13:06:13.640616 11029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:13.640676 11029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39493b9d114c4dbcbd3f055168df5262, State: Initialized, Role: FOLLOWER
I20260806 13:06:13.640911 11029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39493b9d114c4dbcbd3f055168df5262" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35155 } }
I20260806 13:06:13.641029 11029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:13.641120 11029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:13.641189 11029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:13.642025 11029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39493b9d114c4dbcbd3f055168df5262" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35155 } }
I20260806 13:06:13.642190 11029 leader_election.cc:302] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39493b9d114c4dbcbd3f055168df5262; no voters:
I20260806 13:06:13.642469 11029 leader_election.cc:288] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:13.642506 11034 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:13.642668 11034 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [term 1 LEADER]: Becoming Leader. State: Replica: 39493b9d114c4dbcbd3f055168df5262, State: Running, Role: LEADER
I20260806 13:06:13.642867 11029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:13.642867 11034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39493b9d114c4dbcbd3f055168df5262" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35155 } }
I20260806 13:06:13.643424 11034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39493b9d114c4dbcbd3f055168df5262. Latest consensus state: current_term: 1 leader_uuid: "39493b9d114c4dbcbd3f055168df5262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39493b9d114c4dbcbd3f055168df5262" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35155 } } }
I20260806 13:06:13.643738 11034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:13.643637 11035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39493b9d114c4dbcbd3f055168df5262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39493b9d114c4dbcbd3f055168df5262" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35155 } } }
Aug 06 13:06:13 dist-test-slave-srgv krb5kdc[10947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:06:13.644083 11035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:13.644526 11043 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:13.645255 11043 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:13.648428 11043 catalog_manager.cc:1347] Generated new cluster ID: 332e4ad05c474b6282604a9ad43ab3e2
I20260806 13:06:13.648604 11043 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:13.649976 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:13.635261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43329 (local address 127.20.245.190:35155)
0806 13:06:13.635493 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:13.635503 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:13.635534 (+ 31us) server_negotiation.cc:407] Connection header received
0806 13:06:13.636084 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:13.636093 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:13.636152 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:13.636344 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:13.637375 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:13.638671 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:13.640121 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:13.640736 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:13.640883 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:13.644927 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:13.644935 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:13.644935 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:13.644954 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:13.647694 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:13.648274 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:13.648278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:13.648279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:13.648425 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:13.648772 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:13.648773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:13.648774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:13.649152 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:13.649329 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:13.649595 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 13:06:13.649719 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":122,"threads_started":1}
I20260806 13:06:13.651301 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:13.663321 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:13.653393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50111 (local address 127.20.245.190:35155)
0806 13:06:13.653464 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:13.653466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:13.653746 (+ 280us) server_negotiation.cc:407] Connection header received
0806 13:06:13.653828 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:13.653828 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:13.653841 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:13.653914 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:13.654877 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:13.655863 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:13.657134 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:13.657521 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:13.657595 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:13.659639 (+ 2044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:13.659641 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:13.659642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:13.659653 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:13.661678 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:13.662235 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:13.662236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:13.662236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:13.662305 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:13.662565 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:13.662566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:13.662566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:13.662727 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:13.662840 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:13.663040 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 13:06:13.663137 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 13:06:13.672906 11043 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:13.673621 11043 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:13.682337 11043 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39493b9d114c4dbcbd3f055168df5262: Generated new TSK 0
I20260806 13:06:13.682613 11043 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:13.688150 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 10960
W20260806 13:06:13.694861 10945 connection.cc:535] client connection to 127.20.245.190:35155 recv error: Network error: failed to read from TLS socket (remote: 127.20.245.190:35155): Connection reset by peer (error 104)
2026-08-06T13:06:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1513 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:13 dist-test-slave-srgv krb5kdc[11060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:13 dist-test-slave-srgv krb5kdc[11060](info): set up 2 sockets
Aug 06 13:06:13 dist-test-slave-srgv krb5kdc[11060](info): commencing operation
krb5kdc: starting...
W20260806 13:06:14.791940 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:14 dist-test-slave-srgv krb5kdc[11060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:06:14.945006 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35481
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:45259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:35481
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:15.061654 11073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:15.062067 11073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:15.062134 11073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:15.064062 11073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:15.064232 11073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:15.064319 11073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:15.064422 11073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:15.064527 11073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:15.067238 11073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:45259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:35481
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:35481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:15.067868 11073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:15.068409 11073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:15.079267 11081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:15.079263 11078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:15.079295 11079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:15.080250 11073 server_base.cc:1034] running on GCE node
I20260806 13:06:15.080771 11073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:15.081393 11073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:15.082638 11073 hybrid_clock.cc:648] HybridClock initialized: now 1786021575082607 us; error 104 us; skew 500 ppm
Aug 06 13:06:15 dist-test-slave-srgv krb5kdc[11060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021575, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:15.088477 11073 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:06:15.089736 11073 webserver.cc:460] Webserver started at http://127.20.245.190:36565/ using document root <none> and password file <none>
I20260806 13:06:15.090590 11073 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:15.090688 11073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:15.090883 11073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:15.092355 11073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "ee430b7d45994363ab4a607a106b38f9"
format_stamp: "Formatted at 2026-08-06 13:06:15 on dist-test-slave-srgv"
server_key: "77fc1d1be533234db5f6e5b0052fe8a3"
server_key_iv: "7bdb0c80b988c630c495ac7c7a41d8da"
server_key_version: "encryptionkey@0"
I20260806 13:06:15.092813 11073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "ee430b7d45994363ab4a607a106b38f9"
format_stamp: "Formatted at 2026-08-06 13:06:15 on dist-test-slave-srgv"
server_key: "77fc1d1be533234db5f6e5b0052fe8a3"
server_key_iv: "7bdb0c80b988c630c495ac7c7a41d8da"
server_key_version: "encryptionkey@0"
I20260806 13:06:15.094580 11073 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 13:06:15.095606 11088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:15.095845 11073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:15.095974 11073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "ee430b7d45994363ab4a607a106b38f9"
format_stamp: "Formatted at 2026-08-06 13:06:15 on dist-test-slave-srgv"
server_key: "77fc1d1be533234db5f6e5b0052fe8a3"
server_key_iv: "7bdb0c80b988c630c495ac7c7a41d8da"
server_key_version: "encryptionkey@0"
I20260806 13:06:15.096063 11073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:15.108843 11073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:15.111493 11073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:15.111706 11073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:15.117092 11073 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:35481
I20260806 13:06:15.117146 11140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:35481 every 8 connection(s)
I20260806 13:06:15.117626 11073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:15.118906 11141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:15.121896 11141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9: Bootstrap starting.
I20260806 13:06:15.122602 11141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:15.122891 11141 log.cc:824] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:15.123698 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 11073
I20260806 13:06:15.123857 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:15.124084 21462 external_mini_cluster.cc:1428] Setting key 5dd63731cf1909679fdccf9a2f05c289
I20260806 13:06:15.124023 11141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9: No bootstrap required, opened a new log
I20260806 13:06:15.126507 11141 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee430b7d45994363ab4a607a106b38f9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35481 } }
I20260806 13:06:15.126725 11141 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:15.126802 11141 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee430b7d45994363ab4a607a106b38f9, State: Initialized, Role: FOLLOWER
I20260806 13:06:15.126981 11141 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee430b7d45994363ab4a607a106b38f9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35481 } }
I20260806 13:06:15.127103 11141 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:15.127157 11141 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:15.127267 11141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:15.128152 11141 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee430b7d45994363ab4a607a106b38f9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35481 } }
I20260806 13:06:15.128320 11141 leader_election.cc:302] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee430b7d45994363ab4a607a106b38f9; no voters:
I20260806 13:06:15.128602 11141 leader_election.cc:288] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:15.128640 11146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:15.128834 11146 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [term 1 LEADER]: Becoming Leader. State: Replica: ee430b7d45994363ab4a607a106b38f9, State: Running, Role: LEADER
I20260806 13:06:15.129030 11141 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:15.129005 11146 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee430b7d45994363ab4a607a106b38f9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35481 } }
I20260806 13:06:15.129480 11146 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee430b7d45994363ab4a607a106b38f9. Latest consensus state: current_term: 1 leader_uuid: "ee430b7d45994363ab4a607a106b38f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee430b7d45994363ab4a607a106b38f9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35481 } } }
I20260806 13:06:15.129671 11146 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:15.130414 11153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:15.130928 11147 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee430b7d45994363ab4a607a106b38f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee430b7d45994363ab4a607a106b38f9" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 35481 } } }
I20260806 13:06:15.131112 11147 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:15.131264 11153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:15.133579 11145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:15.124846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41797 (local address 127.20.245.190:35481)
0806 13:06:15.125052 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:15.125062 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:15.125102 (+ 40us) server_negotiation.cc:407] Connection header received
0806 13:06:15.126511 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:15.126523 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:15.126605 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:15.126804 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:15.127127 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:15.128836 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:15.130622 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:15.131498 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:15.131653 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:15.132613 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:15.132619 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:15.132619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:15.132883 (+ 264us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:15.132938 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:15.132953 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:15.133105 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:15.133276 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 13:06:15.133313 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
I20260806 13:06:15.133973 11153 catalog_manager.cc:1347] Generated new cluster ID: 3fb0411092064a8db0b4132673e612a3
I20260806 13:06:15.134040 11153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:15.134963 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:15.141367 11145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:15.136955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44029 (local address 127.20.245.190:35481)
0806 13:06:15.137000 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:15.137002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:15.137161 (+ 159us) server_negotiation.cc:407] Connection header received
0806 13:06:15.137221 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:15.137223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:15.137237 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:15.137306 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:15.137516 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:15.138400 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:15.139645 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:15.140006 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:15.140083 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:15.141043 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:15.141044 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:15.141045 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:15.141052 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:15.141073 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:15.141079 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:15.141144 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:15.141238 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 13:06:15.141256 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 13:06:15.157124 11153 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:15.157846 11153 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:15.162904 11153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee430b7d45994363ab4a607a106b38f9: Generated new TSK 0
I20260806 13:06:15.163275 11153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:15.173668 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 11073
W20260806 13:06:15.180385 11058 connection.cc:535] client connection to 127.20.245.190:35481 recv error: Network error: failed to read from TLS socket (remote: 127.20.245.190:35481): Connection reset by peer (error 104)
2026-08-06T13:06:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1485 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:15 dist-test-slave-srgv krb5kdc[11173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:15 dist-test-slave-srgv krb5kdc[11173](info): set up 2 sockets
Aug 06 13:06:15 dist-test-slave-srgv krb5kdc[11173](info): commencing operation
krb5kdc: starting...
W20260806 13:06:16.331877 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:16 dist-test-slave-srgv krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:06:16.483815 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:38559
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:37629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:38559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:16.584949 11186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:16.585253 11186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:16.585282 11186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:16.586695 11186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:16.586755 11186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:16.586771 11186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:16.586783 11186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:16.586848 11186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:16.588611 11186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:37629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:38559
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:38559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:16.588975 11186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:16.589283 11186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:16.595263 11194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:16.595263 11192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:16.595419 11186 server_base.cc:1034] running on GCE node
W20260806 13:06:16.595664 11191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:16.596020 11186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:16.596453 11186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:16.597631 11186 hybrid_clock.cc:648] HybridClock initialized: now 1786021576597584 us; error 62 us; skew 500 ppm
Aug 06 13:06:16 dist-test-slave-srgv krb5kdc[11173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021576, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:16.600874 11186 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:06:16.601743 11186 webserver.cc:460] Webserver started at http://127.20.245.190:43433/ using document root <none> and password file <none>
I20260806 13:06:16.602044 11186 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:16.602135 11186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:16.602327 11186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:16.603853 11186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "619c1e2aee8a4ed0bb1287c32ca47288"
format_stamp: "Formatted at 2026-08-06 13:06:16 on dist-test-slave-srgv"
server_key: "68701f7dd2c45cbe1363bcfc19be7a86"
server_key_iv: "c784d638254e723dda36e515fb2a0ca7"
server_key_version: "encryptionkey@0"
I20260806 13:06:16.604359 11186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "619c1e2aee8a4ed0bb1287c32ca47288"
format_stamp: "Formatted at 2026-08-06 13:06:16 on dist-test-slave-srgv"
server_key: "68701f7dd2c45cbe1363bcfc19be7a86"
server_key_iv: "c784d638254e723dda36e515fb2a0ca7"
server_key_version: "encryptionkey@0"
I20260806 13:06:16.606245 11186 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 13:06:16.607362 11201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:16.607586 11186 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:16.607721 11186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "619c1e2aee8a4ed0bb1287c32ca47288"
format_stamp: "Formatted at 2026-08-06 13:06:16 on dist-test-slave-srgv"
server_key: "68701f7dd2c45cbe1363bcfc19be7a86"
server_key_iv: "c784d638254e723dda36e515fb2a0ca7"
server_key_version: "encryptionkey@0"
I20260806 13:06:16.607897 11186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:16.612447 11186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:16.615283 11186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:16.615476 11186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:16.621187 11186 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:38559
I20260806 13:06:16.621245 11253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:38559 every 8 connection(s)
I20260806 13:06:16.621712 11186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:16.623055 11254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:16.626102 11254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288: Bootstrap starting.
I20260806 13:06:16.626915 11254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:16.627357 11254 log.cc:824] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:16.628361 11254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288: No bootstrap required, opened a new log
I20260806 13:06:16.630417 11254 raft_consensus.cc:348] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c1e2aee8a4ed0bb1287c32ca47288" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38559 } }
I20260806 13:06:16.630612 11254 raft_consensus.cc:374] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:16.630640 11254 raft_consensus.cc:729] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 619c1e2aee8a4ed0bb1287c32ca47288, State: Initialized, Role: FOLLOWER
I20260806 13:06:16.630851 11254 consensus_queue.cc:260] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c1e2aee8a4ed0bb1287c32ca47288" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38559 } }
I20260806 13:06:16.630932 11254 raft_consensus.cc:388] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:16.630983 11254 raft_consensus.cc:482] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:16.631045 11254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:16.631829 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 11186
I20260806 13:06:16.632014 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:16.632303 21462 external_mini_cluster.cc:1428] Setting key 425a3557f8ee7694394996d6339450ac
I20260806 13:06:16.632681 11254 raft_consensus.cc:504] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c1e2aee8a4ed0bb1287c32ca47288" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38559 } }
I20260806 13:06:16.632846 11254 leader_election.cc:302] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 619c1e2aee8a4ed0bb1287c32ca47288; no voters:
I20260806 13:06:16.633116 11254 leader_election.cc:288] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:16.633200 11259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:16.633383 11259 raft_consensus.cc:686] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [term 1 LEADER]: Becoming Leader. State: Replica: 619c1e2aee8a4ed0bb1287c32ca47288, State: Running, Role: LEADER
I20260806 13:06:16.633564 11254 sys_catalog.cc:564] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:16.633585 11259 consensus_queue.cc:237] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c1e2aee8a4ed0bb1287c32ca47288" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38559 } }
I20260806 13:06:16.634730 11260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "619c1e2aee8a4ed0bb1287c32ca47288" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c1e2aee8a4ed0bb1287c32ca47288" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38559 } } }
I20260806 13:06:16.634876 11260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:16.635268 11261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 619c1e2aee8a4ed0bb1287c32ca47288. Latest consensus state: current_term: 1 leader_uuid: "619c1e2aee8a4ed0bb1287c32ca47288" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "619c1e2aee8a4ed0bb1287c32ca47288" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 38559 } } }
I20260806 13:06:16.635550 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:16.632913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44187 (local address 127.20.245.190:38559)
0806 13:06:16.633190 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:16.633202 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:16.633269 (+ 67us) server_negotiation.cc:407] Connection header received
0806 13:06:16.633469 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:16.633508 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:16.633561 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:16.634100 (+ 539us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:16.634782 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:16.634787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:16.634787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:16.634792 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:16.634838 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:16.634854 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:16.635213 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:16.635256 (+ 43us) server_negotiation.cc:299] Negotiation successful
0806 13:06:16.635319 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":135,"threads_started":1}
I20260806 13:06:16.635603 11261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288 [sys.catalog]: This master's current role is: LEADER
W20260806 13:06:16.636380 11275 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:16.636451 11275 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:16.636510 11271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:16.636754 11271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:16.637192 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:16.638885 11271 catalog_manager.cc:1347] Generated new cluster ID: 16fa0842754a461ba44c2d6dde636880
I20260806 13:06:16.638947 11271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:16.640489 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:16.639069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54487 (local address 127.20.245.190:38559)
0806 13:06:16.639108 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:16.639110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:16.639300 (+ 190us) server_negotiation.cc:407] Connection header received
0806 13:06:16.639386 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:16.639387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:16.639395 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:16.639448 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:16.640243 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:16.640244 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:16.640245 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:16.640250 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:16.640272 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:16.640278 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:16.640354 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:16.640401 (+ 47us) server_negotiation.cc:299] Negotiation successful
0806 13:06:16.640416 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 13:06:16.665908 11271 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:16.666265 11271 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:16.673458 11271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 619c1e2aee8a4ed0bb1287c32ca47288: Generated new TSK 0
I20260806 13:06:16.673797 11271 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:16.684670 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 11186
2026-08-06T13:06:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:16 dist-test-slave-srgv krb5kdc[11285](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:16 dist-test-slave-srgv krb5kdc[11285](info): set up 2 sockets
Aug 06 13:06:16 dist-test-slave-srgv krb5kdc[11285](info): commencing operation
krb5kdc: starting...
W20260806 13:06:17.835901 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:17 dist-test-slave-srgv krb5kdc[11285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:06:17.979076 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:34783
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:34833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:34783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:18.076459 11299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:18.076784 11299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:18.076830 11299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:18.078280 11299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:18.078379 11299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:18.078403 11299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:18.078428 11299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:18.078482 11299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:18.080335 11299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:34833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:34783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:34783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:18.080690 11299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:18.080981 11299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:18.086634 11304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:18.086627 11307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:18.086639 11305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:18.086971 11299 server_base.cc:1034] running on GCE node
I20260806 13:06:18.087365 11299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:18.087759 11299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:18.088954 11299 hybrid_clock.cc:648] HybridClock initialized: now 1786021578088925 us; error 60 us; skew 500 ppm
Aug 06 13:06:18 dist-test-slave-srgv krb5kdc[11285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021578, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:18.092213 11299 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:06:18.092823 11299 webserver.cc:460] Webserver started at http://127.20.245.190:41765/ using document root <none> and password file <none>
I20260806 13:06:18.093127 11299 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:18.093180 11299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:18.093366 11299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:18.094810 11299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "30459f200adb4d51800de220801e4065"
format_stamp: "Formatted at 2026-08-06 13:06:18 on dist-test-slave-srgv"
server_key: "6df2e9d9c732bd32c77d26b0eb38120d"
server_key_iv: "6f47175f71bbc5dd94cfb22bab303c25"
server_key_version: "encryptionkey@0"
I20260806 13:06:18.095328 11299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "30459f200adb4d51800de220801e4065"
format_stamp: "Formatted at 2026-08-06 13:06:18 on dist-test-slave-srgv"
server_key: "6df2e9d9c732bd32c77d26b0eb38120d"
server_key_iv: "6f47175f71bbc5dd94cfb22bab303c25"
server_key_version: "encryptionkey@0"
I20260806 13:06:18.097198 11299 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:06:18.098147 11314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:18.098362 11299 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:18.098465 11299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "30459f200adb4d51800de220801e4065"
format_stamp: "Formatted at 2026-08-06 13:06:18 on dist-test-slave-srgv"
server_key: "6df2e9d9c732bd32c77d26b0eb38120d"
server_key_iv: "6f47175f71bbc5dd94cfb22bab303c25"
server_key_version: "encryptionkey@0"
I20260806 13:06:18.098534 11299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:18.117755 11299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:18.121177 11299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:18.121344 11299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:18.126401 11299 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:34783
I20260806 13:06:18.126471 11366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:34783 every 8 connection(s)
I20260806 13:06:18.126940 11299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:18.128144 11367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:18.131309 11367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065: Bootstrap starting.
I20260806 13:06:18.132130 11367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:18.132505 11367 log.cc:824] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:18.133554 11367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065: No bootstrap required, opened a new log
I20260806 13:06:18.135639 11367 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30459f200adb4d51800de220801e4065" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34783 } }
I20260806 13:06:18.135885 11367 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:18.135943 11367 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30459f200adb4d51800de220801e4065, State: Initialized, Role: FOLLOWER
I20260806 13:06:18.136159 11367 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30459f200adb4d51800de220801e4065" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34783 } }
I20260806 13:06:18.136262 11367 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:18.136318 11367 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:18.136376 11367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:18.136670 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 11299
I20260806 13:06:18.136811 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:18.137039 21462 external_mini_cluster.cc:1428] Setting key 47d8c3f3ed189718ed570c9ac1123827
I20260806 13:06:18.137880 11367 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30459f200adb4d51800de220801e4065" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34783 } }
I20260806 13:06:18.138036 11367 leader_election.cc:302] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30459f200adb4d51800de220801e4065; no voters:
I20260806 13:06:18.138263 11367 leader_election.cc:288] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:18.138288 11372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:18.138432 11372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [term 1 LEADER]: Becoming Leader. State: Replica: 30459f200adb4d51800de220801e4065, State: Running, Role: LEADER
I20260806 13:06:18.138612 11367 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:18.138586 11372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30459f200adb4d51800de220801e4065" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34783 } }
I20260806 13:06:18.139254 11373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30459f200adb4d51800de220801e4065" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30459f200adb4d51800de220801e4065" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34783 } } }
I20260806 13:06:18.139276 11374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30459f200adb4d51800de220801e4065. Latest consensus state: current_term: 1 leader_uuid: "30459f200adb4d51800de220801e4065" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30459f200adb4d51800de220801e4065" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 34783 } } }
I20260806 13:06:18.139516 11374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:18.139434 11373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065 [sys.catalog]: This master's current role is: LEADER
W20260806 13:06:18.141057 11388 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:18.141124 11388 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:18.141194 11381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:18.141455 11381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:18.143539 11381 catalog_manager.cc:1347] Generated new cluster ID: 1298f24832fe4dd5acd761fefe478b09
I20260806 13:06:18.143642 11381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 13:06:18 dist-test-slave-srgv krb5kdc[11285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:06:18.151901 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:18.137695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48395 (local address 127.20.245.190:34783)
0806 13:06:18.137986 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:18.138000 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:18.138046 (+ 46us) server_negotiation.cc:407] Connection header received
0806 13:06:18.138243 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:18.138250 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:18.138312 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:18.138512 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:18.139729 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:18.141244 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:18.142367 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:18.143081 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:18.143253 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:18.146668 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:18.146673 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:18.146674 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:18.146689 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:18.149810 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:18.150328 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:18.150332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:18.150332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:18.150476 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:18.150716 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:18.150717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:18.150717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:18.151076 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:18.151287 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:18.151414 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 13:06:18.151573 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":157,"threads_started":1}
I20260806 13:06:18.153142 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:18.157768 11381 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:18.158643 11381 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:18.163743 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:18.155249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60683 (local address 127.20.245.190:34783)
0806 13:06:18.155294 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:18.155296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:18.155309 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:06:18.155390 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:18.155391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:18.155405 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:18.155475 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:18.156239 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:18.156985 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:18.158087 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:18.158403 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:18.158489 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:18.160241 (+ 1752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:18.160243 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:18.160243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:18.160252 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:18.162088 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:18.162675 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:18.162677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:18.162677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:18.162753 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:18.162983 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:18.162983 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:18.162984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:18.163142 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:18.163321 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:18.163487 (+ 166us) server_negotiation.cc:299] Negotiation successful
0806 13:06:18.163615 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 13:06:18.166368 11381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30459f200adb4d51800de220801e4065: Generated new TSK 0
I20260806 13:06:18.166643 11381 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:18.172948 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 11299
2026-08-06T13:06:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:18 dist-test-slave-srgv krb5kdc[11398](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:18 dist-test-slave-srgv krb5kdc[11398](info): set up 2 sockets
Aug 06 13:06:18 dist-test-slave-srgv krb5kdc[11398](info): commencing operation
krb5kdc: starting...
W20260806 13:06:19.289338 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:19 dist-test-slave-srgv krb5kdc[11398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:06:19.434043 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:44411
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:46103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:44411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:19.530216 11411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:19.530560 11411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:19.530619 11411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:19.532035 11411 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:19.532114 11411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:19.532140 11411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:19.532161 11411 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:19.532193 11411 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:19.533926 11411 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:46103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:44411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:44411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:19.534274 11411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:19.534564 11411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:19.540758 11416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:19.540807 11419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:19.540758 11417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:19.541270 11411 server_base.cc:1034] running on GCE node
I20260806 13:06:19.541592 11411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:19.542050 11411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:19.543226 11411 hybrid_clock.cc:648] HybridClock initialized: now 1786021579543193 us; error 50 us; skew 500 ppm
Aug 06 13:06:19 dist-test-slave-srgv krb5kdc[11398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021579, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:19.554867 11411 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:06:19.555620 11411 webserver.cc:460] Webserver started at http://127.20.245.190:40201/ using document root <none> and password file <none>
I20260806 13:06:19.555934 11411 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:19.556015 11411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:19.556197 11411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:19.557615 11411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca"
format_stamp: "Formatted at 2026-08-06 13:06:19 on dist-test-slave-srgv"
server_key: "a2b275b967df0d7268e119eb73f25527"
server_key_iv: "b9635def7f4eb8f72f77bd2fb26c3529"
server_key_version: "encryptionkey@0"
I20260806 13:06:19.558053 11411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca"
format_stamp: "Formatted at 2026-08-06 13:06:19 on dist-test-slave-srgv"
server_key: "a2b275b967df0d7268e119eb73f25527"
server_key_iv: "b9635def7f4eb8f72f77bd2fb26c3529"
server_key_version: "encryptionkey@0"
I20260806 13:06:19.559784 11411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260806 13:06:19.560706 11426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:19.560928 11411 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:19.561050 11411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca"
format_stamp: "Formatted at 2026-08-06 13:06:19 on dist-test-slave-srgv"
server_key: "a2b275b967df0d7268e119eb73f25527"
server_key_iv: "b9635def7f4eb8f72f77bd2fb26c3529"
server_key_version: "encryptionkey@0"
I20260806 13:06:19.561139 11411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:19.577598 11411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:19.580487 11411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:19.580734 11411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:19.586261 11411 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:44411
I20260806 13:06:19.586310 11478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:44411 every 8 connection(s)
I20260806 13:06:19.586800 11411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:19.588124 11479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:19.591572 11479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca: Bootstrap starting.
I20260806 13:06:19.591724 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 11411
I20260806 13:06:19.591887 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:19.592103 21462 external_mini_cluster.cc:1428] Setting key 88985f934df5275842cb33c159d87f0d
I20260806 13:06:19.592631 11479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:19.593154 11479 log.cc:824] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:19.594246 11479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca: No bootstrap required, opened a new log
I20260806 13:06:19.596745 11479 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44411 } }
I20260806 13:06:19.597007 11479 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:19.597067 11479 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9be0d5ae9a4299a57d1a7004a8f5ca, State: Initialized, Role: FOLLOWER
I20260806 13:06:19.597304 11479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44411 } }
I20260806 13:06:19.597437 11479 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:19.597510 11479 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:19.597576 11479 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:19.598573 11479 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44411 } }
I20260806 13:06:19.598734 11479 leader_election.cc:302] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e9be0d5ae9a4299a57d1a7004a8f5ca; no voters:
I20260806 13:06:19.599009 11479 leader_election.cc:288] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:19.599057 11484 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:19.599269 11484 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [term 1 LEADER]: Becoming Leader. State: Replica: 0e9be0d5ae9a4299a57d1a7004a8f5ca, State: Running, Role: LEADER
I20260806 13:06:19.599406 11482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:19.592853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45151 (local address 127.20.245.190:44411)
0806 13:06:19.593154 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:19.593164 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:19.593198 (+ 34us) server_negotiation.cc:407] Connection header received
0806 13:06:19.594001 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:19.594012 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:19.594080 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:19.594270 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:19.594562 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:19.595672 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:19.596620 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:19.597225 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:19.597365 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:19.598262 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:19.598268 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:19.598269 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:19.598505 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:19.598560 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:19.598575 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:19.598678 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:19.598958 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 13:06:19.599065 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":127,"threads_started":1}
I20260806 13:06:19.599411 11479 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:19.599436 11484 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44411 } }
I20260806 13:06:19.600756 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:19.601383 11485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44411 } } }
I20260806 13:06:19.601537 11485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:19.601538 11486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e9be0d5ae9a4299a57d1a7004a8f5ca. Latest consensus state: current_term: 1 leader_uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e9be0d5ae9a4299a57d1a7004a8f5ca" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 44411 } } }
I20260806 13:06:19.601862 11486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca [sys.catalog]: This master's current role is: LEADER
W20260806 13:06:19.602032 11499 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:19.602109 11499 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:19.602171 11500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:19.602406 11500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:19.604489 11500 catalog_manager.cc:1347] Generated new cluster ID: 886db35564c44233bd24536661ef4a6c
I20260806 13:06:19.604579 11500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:19.606690 11482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:19.602840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38355 (local address 127.20.245.190:44411)
0806 13:06:19.602885 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:19.602887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:19.602941 (+ 54us) server_negotiation.cc:407] Connection header received
0806 13:06:19.603018 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:19.603018 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:19.603027 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:19.603079 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:19.603289 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:19.604065 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:19.605135 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:19.605442 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:19.605531 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:19.606411 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:19.606413 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:19.606413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:19.606420 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:19.606441 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:19.606447 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:19.606504 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:19.606572 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 13:06:19.606604 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 13:06:19.631086 11500 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:19.632288 11500 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:19.645987 11500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e9be0d5ae9a4299a57d1a7004a8f5ca: Generated new TSK 0
I20260806 13:06:19.646396 11500 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:19.650708 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 11411
2026-08-06T13:06:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:19 dist-test-slave-srgv krb5kdc[11510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:19 dist-test-slave-srgv krb5kdc[11510](info): set up 2 sockets
Aug 06 13:06:19 dist-test-slave-srgv krb5kdc[11510](info): commencing operation
krb5kdc: starting...
W20260806 13:06:20.757237 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.002s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:20 dist-test-slave-srgv krb5kdc[11510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:06:20.926960 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:45589
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:38025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:45589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:21.035612 11524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:21.035970 11524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:21.036017 11524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:21.037555 11524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:21.037647 11524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:21.037673 11524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:21.037705 11524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:21.037760 11524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:21.039695 11524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:38025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:45589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:45589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:21.040050 11524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:21.040366 11524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:21.046762 11532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:21.046785 11524 server_base.cc:1034] running on GCE node
W20260806 13:06:21.046762 11530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:21.046738 11529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:21.047420 11524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:21.047747 11524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:21.048990 11524 hybrid_clock.cc:648] HybridClock initialized: now 1786021581048977 us; error 51 us; skew 500 ppm
Aug 06 13:06:21 dist-test-slave-srgv krb5kdc[11510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021581, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:21.052374 11524 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:06:21.052965 11524 webserver.cc:460] Webserver started at http://127.20.245.190:33265/ using document root <none> and password file <none>
I20260806 13:06:21.053213 11524 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:21.053260 11524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:21.053373 11524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:21.054651 11524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "5ee6e0a3b47444ed8e7834da71d79778"
format_stamp: "Formatted at 2026-08-06 13:06:21 on dist-test-slave-srgv"
server_key: "22d7cfdddd3773d370b5d46cbe5a0a0d"
server_key_iv: "9c2d38aa6f4bb5c2dd30577ad3b3d3ea"
server_key_version: "encryptionkey@0"
I20260806 13:06:21.055022 11524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "5ee6e0a3b47444ed8e7834da71d79778"
format_stamp: "Formatted at 2026-08-06 13:06:21 on dist-test-slave-srgv"
server_key: "22d7cfdddd3773d370b5d46cbe5a0a0d"
server_key_iv: "9c2d38aa6f4bb5c2dd30577ad3b3d3ea"
server_key_version: "encryptionkey@0"
I20260806 13:06:21.056830 11524 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 13:06:21.057796 11539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:21.057994 11524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:21.058101 11524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "5ee6e0a3b47444ed8e7834da71d79778"
format_stamp: "Formatted at 2026-08-06 13:06:21 on dist-test-slave-srgv"
server_key: "22d7cfdddd3773d370b5d46cbe5a0a0d"
server_key_iv: "9c2d38aa6f4bb5c2dd30577ad3b3d3ea"
server_key_version: "encryptionkey@0"
I20260806 13:06:21.058178 11524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:21.062522 11524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:21.065114 11524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:21.065253 11524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:21.070312 11524 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:45589
I20260806 13:06:21.070386 11592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:45589 every 8 connection(s)
I20260806 13:06:21.070963 11524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:21.072552 11593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:21.074916 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 11524
I20260806 13:06:21.075093 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:21.075381 21462 external_mini_cluster.cc:1428] Setting key 08fde5f7f71d59f95a9ffe4694702027
I20260806 13:06:21.075934 11593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778: Bootstrap starting.
I20260806 13:06:21.076787 11593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:21.077153 11593 log.cc:824] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:21.078265 11593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778: No bootstrap required, opened a new log
I20260806 13:06:21.078665 11596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:21.076143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55885 (local address 127.20.245.190:45589)
0806 13:06:21.076380 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:21.076390 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:21.076422 (+ 32us) server_negotiation.cc:407] Connection header received
0806 13:06:21.077057 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:21.077067 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:21.077100 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:21.077301 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:21.078133 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:21.078137 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:21.078138 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:21.078142 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:21.078191 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:21.078204 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:21.078284 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:21.078384 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 13:06:21.078462 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":107,"threads_started":1}
I20260806 13:06:21.079978 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:21.081158 11593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee6e0a3b47444ed8e7834da71d79778" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45589 } }
I20260806 13:06:21.081378 11593 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 13:06:21.081434 11593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ee6e0a3b47444ed8e7834da71d79778, State: Initialized, Role: FOLLOWER
I20260806 13:06:21.081586 11593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee6e0a3b47444ed8e7834da71d79778" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45589 } }
I20260806 13:06:21.081691 11593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 13:06:21.081717 11593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 13:06:21.081869 11593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:21.082890 11593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee6e0a3b47444ed8e7834da71d79778" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45589 } }
I20260806 13:06:21.083045 11593 leader_election.cc:302] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ee6e0a3b47444ed8e7834da71d79778; no voters:
I20260806 13:06:21.083349 11593 leader_election.cc:288] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 13:06:21.083365 11603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:21.083596 11596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:21.081888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53815 (local address 127.20.245.190:45589)
0806 13:06:21.081961 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:21.081963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:21.082184 (+ 221us) server_negotiation.cc:407] Connection header received
0806 13:06:21.082337 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:21.082346 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:21.082352 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:21.082474 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:21.083289 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:21.083291 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:21.083291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 13:06:21.083295 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:21.083311 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 13:06:21.083315 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:21.083385 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:21.083472 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 13:06:21.083489 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 13:06:21.083724 11593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:21.083526 11603 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [term 1 LEADER]: Becoming Leader. State: Replica: 5ee6e0a3b47444ed8e7834da71d79778, State: Running, Role: LEADER
I20260806 13:06:21.084024 11603 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee6e0a3b47444ed8e7834da71d79778" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45589 } }
I20260806 13:06:21.084564 11605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ee6e0a3b47444ed8e7834da71d79778. Latest consensus state: current_term: 1 leader_uuid: "5ee6e0a3b47444ed8e7834da71d79778" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee6e0a3b47444ed8e7834da71d79778" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45589 } } }
I20260806 13:06:21.084679 11605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:21.084785 11604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ee6e0a3b47444ed8e7834da71d79778" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee6e0a3b47444ed8e7834da71d79778" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 45589 } } }
I20260806 13:06:21.084872 11604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:21.085328 11612 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:21.085947 11612 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:21.088093 11612 catalog_manager.cc:1347] Generated new cluster ID: 88108b78dda948deba71227c422c08e1
I20260806 13:06:21.088162 11612 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:21.095644 11612 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:21.095923 11612 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:21.101619 11612 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ee6e0a3b47444ed8e7834da71d79778: Generated new TSK 0
I20260806 13:06:21.101912 11612 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 13:06:21.108135 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 11524
2026-08-06T13:06:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1457 ms)
[----------] 18 tests from AuthTokenIssuingTest (26578 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:21 dist-test-slave-srgv krb5kdc[11625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:21 dist-test-slave-srgv krb5kdc[11625](info): set up 2 sockets
Aug 06 13:06:21 dist-test-slave-srgv krb5kdc[11625](info): commencing operation
krb5kdc: starting...
W20260806 13:06:22.242869 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:06:22.399812 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:40437
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:40437,127.20.245.189:34663,127.20.245.188:33365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:22.510257 11638 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 13:06:22.510574 11638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:22.510594 11638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:22.510620 11638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:22.512214 11638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:22.512286 11638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:22.512302 11638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:22.512315 11638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:22.512328 11638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:22.514168 11638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:40437,127.20.245.189:34663,127.20.245.188:33365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:40437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:22.514531 11638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:22.514839 11638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:06:22.521166 11638 server_base.cc:1034] running on GCE node
W20260806 13:06:22.521142 11643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:22.521130 11646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:22.521142 11644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:22.521899 11638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:22.522324 11638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:22.523524 11638 hybrid_clock.cc:648] HybridClock initialized: now 1786021582523514 us; error 61 us; skew 500 ppm
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:22.527114 11638 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:06:22.527801 11638 webserver.cc:460] Webserver started at http://127.20.245.190:43075/ using document root <none> and password file <none>
I20260806 13:06:22.528127 11638 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:22.528223 11638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:22.528411 11638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:22.529835 11638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "123b7e1a072a48e1936c16c09cd4c142"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "b82d61b1bfd8fbfcbdb5ebe90d6ded6a"
server_key_iv: "5eb28b8b3eabb2d075ea47246862bc74"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.530314 11638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "123b7e1a072a48e1936c16c09cd4c142"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "b82d61b1bfd8fbfcbdb5ebe90d6ded6a"
server_key_iv: "5eb28b8b3eabb2d075ea47246862bc74"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.532194 11638 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260806 13:06:22.533258 11653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:22.533531 11638 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:22.533664 11638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "123b7e1a072a48e1936c16c09cd4c142"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "b82d61b1bfd8fbfcbdb5ebe90d6ded6a"
server_key_iv: "5eb28b8b3eabb2d075ea47246862bc74"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.533771 11638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:22.557659 11638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:22.560679 11638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:22.560930 11638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:22.566769 11638 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:40437
I20260806 13:06:22.566819 11706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:40437 every 8 connection(s)
I20260806 13:06:22.567369 11638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:22.567993 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 11638
I20260806 13:06:22.568138 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:22.568353 21462 external_mini_cluster.cc:1428] Setting key 92074b9b95f2d1d6979fc1c32747c740
I20260806 13:06:22.568756 11707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:22.571516 11707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.245.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.189@KRBTEST.COM" created.
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:06:22.588332 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.572824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44214 (local address 127.20.245.190:40437)
0806 13:06:22.573090 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.573103 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.573368 (+ 265us) server_negotiation.cc:407] Connection header received
0806 13:06:22.574409 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.574413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.574445 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.574546 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.575554 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.576507 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.577977 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.578354 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.578464 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.583928 (+ 5464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.583944 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.583944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.583956 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.586185 (+ 2229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.586833 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.586837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.586838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.586942 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.587287 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.587288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.587289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.587607 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.587685 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.587966 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.588093 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":137,"threads_started":1}
I20260806 13:06:22.588469 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.572797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:40437 (local address 127.0.0.1:44214)
0806 13:06:22.573177 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.573228 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:22.574166 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:22.574588 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:22.574593 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:22.575076 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:22.575419 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.575428 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.576627 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.576628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.577860 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.577864 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.578471 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.578472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.578574 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.579323 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:22.579336 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:22.583784 (+ 4448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:22.586309 (+ 2525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.586321 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.586324 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.586699 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.587015 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.587016 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.587016 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.587162 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.587688 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:22.587697 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:22.587794 (+ 97us) client_negotiation.cc:769] Sending connection context
0806 13:06:22.587909 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 13:06:22.588228 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":75,"thread_start_us":142,"threads_started":1}
I20260806 13:06:22.589797 11707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:22.590342 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.590166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56456)
0806 13:06:22.590226 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.590311 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 13:06:22.590538 11657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
I20260806 13:06:22.591122 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.591007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56464)
0806 13:06:22.591071 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.591101 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 13:06:22.591274 11707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:34663: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab.
Entry for principal kudu/127.20.245.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab.
I20260806 13:06:22.603925 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.189:34663
--webserver_interface=127.20.245.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab
--principal=kudu/127.20.245.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:40437,127.20.245.189:34663,127.20.245.188:33365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:06:22.640652 11707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } attempt: 1
I20260806 13:06:22.641454 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.641244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56470)
0806 13:06:22.641351 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.641407 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 13:06:22.641923 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.641814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56474)
0806 13:06:22.641867 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.641898 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 13:06:22.642071 11707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:34663: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
W20260806 13:06:22.704409 11714 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 13:06:22.704746 11714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:22.704770 11714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:22.704797 11714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:22.706194 11714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:22.706239 11714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:22.706254 11714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:22.706267 11714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:22.706280 11714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:22.708005 11714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:40437,127.20.245.189:34663,127.20.245.188:33365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab
--principal=kudu/127.20.245.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.189:34663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.245.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:22.708298 11714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:22.708536 11714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:06:22.710278 11707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } attempt: 2
I20260806 13:06:22.710997 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.710808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56486)
0806 13:06:22.710898 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.710953 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 13:06:22.711449 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.711330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56500)
0806 13:06:22.711381 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.711411 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 13:06:22.711558 11707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:34663: Network error: Client connection negotiation failed: client connection to 127.20.245.189:34663: connect: Connection refused (error 111)
W20260806 13:06:22.714394 11720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:22.714444 11722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:22.714501 11719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:22.715238 11714 server_base.cc:1034] running on GCE node
I20260806 13:06:22.715575 11714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:22.716029 11714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:22.717229 11714 hybrid_clock.cc:648] HybridClock initialized: now 1786021582717197 us; error 52 us; skew 500 ppm
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:22.720371 11714 init.cc:377] Logged in from keytab as kudu/127.20.245.189@KRBTEST.COM (short username kudu)
I20260806 13:06:22.721101 11714 webserver.cc:460] Webserver started at http://127.20.245.189:43563/ using document root <none> and password file <none>
I20260806 13:06:22.721380 11714 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:22.721453 11714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:22.721630 11714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:22.722970 11714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/data/instance:
uuid: "82c7a712bc5342c382045018514bdf61"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "f58d24544f0c813362112b29f6dc020c"
server_key_iv: "ff2d71ebd1b6ded7aa7ed15c295afd79"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.723444 11714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/wal/instance:
uuid: "82c7a712bc5342c382045018514bdf61"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "f58d24544f0c813362112b29f6dc020c"
server_key_iv: "ff2d71ebd1b6ded7aa7ed15c295afd79"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.725296 11714 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 13:06:22.726352 11729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:22.726575 11714 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 13:06:22.726716 11714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/wal
uuid: "82c7a712bc5342c382045018514bdf61"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "f58d24544f0c813362112b29f6dc020c"
server_key_iv: "ff2d71ebd1b6ded7aa7ed15c295afd79"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.726818 11714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:22.741607 11714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:22.744755 11714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:22.744997 11714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:22.750761 11714 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.189:34663
I20260806 13:06:22.750797 11781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.189:34663 every 8 connection(s)
I20260806 13:06:22.751391 11714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
I20260806 13:06:22.752648 11782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:22.754801 11782 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:22.761487 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 11714
I20260806 13:06:22.761624 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-1/wal/instance
I20260806 13:06:22.761857 21462 external_mini_cluster.cc:1428] Setting key dfa70e7e6526ab19483b0103dcf62826
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:06:22.766857 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.755829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44226 (local address 127.20.245.190:40437)
0806 13:06:22.755969 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.755971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.756229 (+ 258us) server_negotiation.cc:407] Connection header received
0806 13:06:22.756858 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.756859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.756877 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.756947 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.757739 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.758311 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.759458 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.759701 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.759824 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.762797 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.762799 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.762800 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.762809 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.764835 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.765479 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.765480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.765480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.765551 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.765940 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.765942 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.765942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.766142 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.766219 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.766662 (+ 443us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.766767 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 13:06:22.767251 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.755763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:40437 (local address 127.0.0.1:44226)
0806 13:06:22.756047 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.756110 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:22.756736 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:22.757034 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:22.757037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:22.757348 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:22.757627 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.757632 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.758435 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.758436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.759368 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.759371 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.759835 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.759837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.759989 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.760653 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:22.760664 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:22.762650 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:22.764947 (+ 2297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.764957 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.764960 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.765378 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.765656 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.765657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.765658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.765839 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.766225 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:22.766233 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:22.766456 (+ 223us) client_negotiation.cc:769] Sending connection context
0806 13:06:22.766616 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 13:06:22.766843 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":120,"threads_started":1}
I20260806 13:06:22.768218 11782 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.245.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.188@KRBTEST.COM" created.
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:06:22.781396 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.768754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56506 (local address 127.20.245.189:34663)
0806 13:06:22.768982 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.768988 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.769007 (+ 19us) server_negotiation.cc:407] Connection header received
0806 13:06:22.769029 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.769032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.769046 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.769195 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.769617 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.770508 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.771656 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.772078 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.772245 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.777429 (+ 5184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.777454 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.777454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.777467 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.779806 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.780333 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.780337 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.780337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.780402 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.780638 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.780639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.780639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.780834 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.780902 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.781173 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.781264 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":141,"threads_started":1}
I20260806 13:06:22.781415 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.768620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56506)
0806 13:06:22.768693 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.768706 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:22.768749 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:22.769224 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:22.769225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:22.769426 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:22.769517 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.769519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.770619 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.770620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.771527 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.771531 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.772269 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.772270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.772359 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.772905 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:22.772911 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:22.777284 (+ 4373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:22.779923 (+ 2639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.779925 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.779926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.780216 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.780481 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.780483 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.780483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.780565 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.780904 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:22.780905 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:22.780966 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 13:06:22.781050 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 13:06:22.781205 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 13:06:22.782511 11782 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:22.783046 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.782850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:43956)
0806 13:06:22.782919 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.782993 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 13:06:22.783330 11732 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
I20260806 13:06:22.783932 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.783800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:43964)
0806 13:06:22.783857 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.783896 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260806 13:06:22.784116 11782 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33365: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab.
Entry for principal kudu/127.20.245.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab.
I20260806 13:06:22.800031 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.188:33365
--webserver_interface=127.20.245.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab
--principal=kudu/127.20.245.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:40437,127.20.245.189:34663,127.20.245.188:33365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:06:22.802755 11707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } attempt: 3
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:06:22.813015 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.803427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56522)
0806 13:06:22.803546 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.803566 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:22.803699 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:22.803919 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:22.803920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:22.804148 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:22.804260 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.804262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.805371 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.805372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.806063 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.806066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.806717 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.806718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.806810 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.807545 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:22.807551 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:22.809130 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:22.811642 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.811644 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.811644 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.811882 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.812181 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.812183 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.812183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.812297 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.812663 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:22.812664 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:22.812727 (+ 63us) client_negotiation.cc:769] Sending connection context
0806 13:06:22.812791 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 13:06:22.812911 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 13:06:22.813130 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.803621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56522 (local address 127.20.245.189:34663)
0806 13:06:22.803713 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.803716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.803734 (+ 18us) server_negotiation.cc:407] Connection header received
0806 13:06:22.803774 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.803775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.803793 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.803864 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.804368 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.805245 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.806174 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.806592 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.806693 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.809262 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.809264 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.809265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.809278 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.811484 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.811978 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.811980 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.811980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.812064 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.812378 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.812380 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.812381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.812585 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.812673 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.812850 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.812965 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 13:06:22.813830 11707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:22.814349 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.814198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:43966)
0806 13:06:22.814288 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.814319 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 13:06:22.814793 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.814707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:43976)
0806 13:06:22.814750 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.814775 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 13:06:22.814905 11707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33365: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
I20260806 13:06:22.833448 11782 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } attempt: 1
I20260806 13:06:22.834227 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.834029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:43980)
0806 13:06:22.834116 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.834178 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 13:06:22.834748 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.834639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:43986)
0806 13:06:22.834692 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.834726 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 13:06:22.834959 11782 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33365: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
I20260806 13:06:22.846091 11707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } attempt: 1
I20260806 13:06:22.846846 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.846658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44002)
0806 13:06:22.846750 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.846805 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 13:06:22.847345 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.847237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44008)
0806 13:06:22.847290 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.847320 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260806 13:06:22.847469 11707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33365: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
I20260806 13:06:22.903237 11782 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } attempt: 2
I20260806 13:06:22.904039 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.903796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44012)
0806 13:06:22.903887 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.903986 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 13:06:22.904626 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.904478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44014)
0806 13:06:22.904545 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.904581 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 13:06:22.904778 11782 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33365: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
W20260806 13:06:22.908339 11789 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 13:06:22.908586 11789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:22.908605 11789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:22.908670 11789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:22.910120 11789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:22.910176 11789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:22.910198 11789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:22.910216 11789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:22.910239 11789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:22.912024 11789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:40437,127.20.245.189:34663,127.20.245.188:33365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab
--principal=kudu/127.20.245.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.188:33365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.245.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:22.912303 11789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:22.912518 11789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:22.918227 11794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:22.918253 11795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:22.918300 11789 server_base.cc:1034] running on GCE node
W20260806 13:06:22.918211 11797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:22.918781 11789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:22.919209 11789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:22.920445 11789 hybrid_clock.cc:648] HybridClock initialized: now 1786021582920422 us; error 50 us; skew 500 ppm
I20260806 13:06:22.922636 11707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } attempt: 2
I20260806 13:06:22.923280 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.923064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44020)
0806 13:06:22.923143 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.923237 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:22.923768 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.923656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44034)
0806 13:06:22.923703 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.923734 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260806 13:06:22.923866 11707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33365: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33365: connect: Connection refused (error 111)
I20260806 13:06:22.924137 11789 init.cc:377] Logged in from keytab as kudu/127.20.245.188@KRBTEST.COM (short username kudu)
I20260806 13:06:22.924826 11789 webserver.cc:460] Webserver started at http://127.20.245.188:40185/ using document root <none> and password file <none>
I20260806 13:06:22.925168 11789 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:22.925266 11789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:22.925467 11789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:22.927023 11789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/data/instance:
uuid: "70b0613070a0491ea6bd0dd525dc5460"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "367d736210da3f6a2772b73a1991e8b4"
server_key_iv: "f08f9f466cedcc59c5f7262bea33d966"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.927606 11789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/wal/instance:
uuid: "70b0613070a0491ea6bd0dd525dc5460"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "367d736210da3f6a2772b73a1991e8b4"
server_key_iv: "f08f9f466cedcc59c5f7262bea33d966"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.929569 11789 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:06:22.930596 11804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:22.930852 11789 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:22.930985 11789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/wal
uuid: "70b0613070a0491ea6bd0dd525dc5460"
format_stamp: "Formatted at 2026-08-06 13:06:22 on dist-test-slave-srgv"
server_key: "367d736210da3f6a2772b73a1991e8b4"
server_key_iv: "f08f9f466cedcc59c5f7262bea33d966"
server_key_version: "encryptionkey@0"
I20260806 13:06:22.931097 11789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:22.941401 11789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:22.944202 11789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:22.944415 11789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:22.949710 11789 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.188:33365
I20260806 13:06:22.949749 11857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.188:33365 every 8 connection(s)
I20260806 13:06:22.950225 11789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
I20260806 13:06:22.951507 11858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:22.953475 11858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:22.958420 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 11789
I20260806 13:06:22.958602 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786021275077601-21462-0/minicluster-data/master-2/wal/instance
I20260806 13:06:22.958847 21462 external_mini_cluster.cc:1428] Setting key 1c5759483af015400d589d1033bbc29e
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:06:22.966303 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.954400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44240 (local address 127.20.245.190:40437)
0806 13:06:22.954483 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.954485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.954756 (+ 271us) server_negotiation.cc:407] Connection header received
0806 13:06:22.955426 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.955428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.955440 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.955509 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.956405 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.957090 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.958864 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.959231 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.959318 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.962581 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.962584 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.962584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.962594 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.964492 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.965030 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.965032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.965033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.965107 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.965420 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.965421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.965421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.965570 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.965647 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.966069 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.966178 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 13:06:22.966555 11860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.954359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:40437 (local address 127.0.0.1:44240)
0806 13:06:22.954596 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.954648 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:22.955319 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:22.955605 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:22.955609 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:22.955939 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:22.956282 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.956287 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.957228 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.957230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.958754 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.958757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.959399 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.959400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.959565 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.960429 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:22.960440 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:22.962459 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:22.964605 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.964618 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.964622 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.964933 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.965180 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.965181 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.965182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.965338 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.965647 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:22.965657 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:22.965894 (+ 237us) client_negotiation.cc:769] Sending connection context
0806 13:06:22.966035 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 13:06:22.966232 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":144,"threads_started":1}
I20260806 13:06:22.967514 11858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:22.970108 11862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.959415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44048 (local address 127.20.245.188:33365)
0806 13:06:22.959652 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.959659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.959794 (+ 135us) server_negotiation.cc:407] Connection header received
0806 13:06:22.959824 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.959827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.959854 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.959949 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.960796 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.961738 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.962849 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.963349 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.963445 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.966305 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.966324 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.966324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.966333 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.968711 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.969174 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.969178 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.969178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.969259 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.969508 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.969509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.969509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.969661 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.969834 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.969922 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.969992 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":131,"threads_started":1}
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:06:22.975875 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.967987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56532 (local address 127.20.245.189:34663)
0806 13:06:22.968052 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.968055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.968066 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:06:22.968100 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.968101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.968113 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.968191 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.968460 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.969160 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.970138 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.970410 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.970465 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.972630 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.972632 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.972632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.972643 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.974514 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.974934 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.974935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.974936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.975012 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.975269 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.975270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.975271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.975434 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.975514 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.975684 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.975796 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 13:06:22.975914 11860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.967902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:34663 (local address 127.0.0.1:56532)
0806 13:06:22.967965 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.967974 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:22.968007 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:22.968201 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:22.968202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:22.968324 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:22.968378 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.968379 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.969233 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.969234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.970044 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.970047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.970473 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.970474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.970548 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.970998 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:22.971004 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:22.972528 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:22.974620 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.974622 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.974622 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.974833 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.975091 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.975092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.975092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.975151 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.975514 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:22.975515 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:22.975564 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 13:06:22.975625 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 13:06:22.975758 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:06:22.976636 11858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:22.980187 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.971624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44246 (local address 127.20.245.190:40437)
0806 13:06:22.971674 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.971676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.971686 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:06:22.971717 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.971719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.971730 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.971791 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.972348 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.972904 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.973663 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.973927 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.974008 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.976988 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.976990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.976991 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.977001 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.978648 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.979057 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.979059 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.979060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.979132 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.979418 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.979419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.979420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.979597 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.979899 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.979943 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.980034 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:06:22.984706 11860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.977011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44050)
0806 13:06:22.977061 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.977072 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:22.977114 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:22.977243 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:22.977244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:22.977399 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:22.977439 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.977441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.978135 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.978137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.978654 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.978655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.979054 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.979055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.979105 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.979584 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:22.979588 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:22.981248 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:22.983169 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.983171 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.983212 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.983472 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.983781 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:22.983782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:22.983782 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:22.983851 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:22.984292 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:22.984293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:22.984338 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 13:06:22.984397 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 13:06:22.984548 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 13:06:22.984706 11862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.977050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44050 (local address 127.20.245.188:33365)
0806 13:06:22.977092 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.977094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.977103 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:06:22.977171 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.977172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.977184 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.977240 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.977515 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.978045 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.978749 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.978979 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.979059 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.981345 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.981347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.981347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.981356 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.983046 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.983597 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.983598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.983599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.983679 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.983977 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.983979 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.983979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.984207 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.984296 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.984452 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.984615 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":24}
I20260806 13:06:22.986590 11858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460: Bootstrap starting.
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:06:22.988049 11858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:22.988485 11858 log.cc:824] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:22.989709 11858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460: No bootstrap required, opened a new log
I20260806 13:06:22.990857 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.981156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.20.245.189:34663)
0806 13:06:22.981206 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.981207 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.981278 (+ 71us) server_negotiation.cc:407] Connection header received
0806 13:06:22.981357 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.981358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.981371 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.981439 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.982088 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.982912 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.983992 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.984355 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.984459 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:22.987383 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:22.987385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:22.987385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:22.987395 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:22.989336 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.989854 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.989856 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.989857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.989932 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:22.990230 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:22.990231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:22.990231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:22.990373 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:22.990615 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:22.990655 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 13:06:22.990743 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 13:06:22.992162 11858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } }
I20260806 13:06:22.992373 11858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70b0613070a0491ea6bd0dd525dc5460, State: Initialized, Role: FOLLOWER
I20260806 13:06:22.992499 11858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } }
I20260806 13:06:22.993010 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:22.993053 11858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:22.992980 11864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:22.993101 11864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 13:06:22.995814 11875 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:22.995913 11875 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:22.995930 11782 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } attempt: 3
I20260806 13:06:22.995064 11680 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "123b7e1a072a48e1936c16c09cd4c142"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44246
I20260806 13:06:22.995797 11789 master_runner.cc:186] Error getting master registration for 127.20.245.190:40437: OK, instance_id { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" instance_seqno: 1786021582565112 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 13:06:22.998591 11789 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 13:06:22 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:06:23.006316 11862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.996509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44066 (local address 127.20.245.188:33365)
0806 13:06:22.996570 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:22.996573 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:22.996583 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:06:22.996610 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:22.996611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:22.996624 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:22.996706 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:22.997220 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.998070 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.999628 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.999950 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.000042 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:23.002449 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:23.002451 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:23.002452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:23.002461 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:23.004466 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.005188 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.005190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.005191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.005269 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.005544 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.005545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.005545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.005799 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:23.005881 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:23.006076 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 13:06:23.006197 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 13:06:23.006328 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:22.996250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44066)
0806 13:06:22.996359 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:22.996373 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:22.996419 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:22.996725 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:22.996726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:22.997054 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:22.997127 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.997131 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:22.998188 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:22.998189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:22.999542 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:22.999547 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.000085 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.000086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:23.000151 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:23.000791 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:23.000796 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:23.002323 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:23.004587 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:23.004589 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:23.004590 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:23.004854 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:23.005367 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:23.005369 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:23.005369 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:23.005464 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:23.005875 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:23.005876 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:23.005949 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 13:06:23.006031 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 13:06:23.006192 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260806 13:06:23.008504 11782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61: Bootstrap starting.
I20260806 13:06:23.009433 11782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:23.009807 11782 log.cc:824] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:23.010835 11782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61: No bootstrap required, opened a new log
I20260806 13:06:23.012743 11782 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } }
I20260806 13:06:23.012957 11782 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82c7a712bc5342c382045018514bdf61, State: Initialized, Role: FOLLOWER
I20260806 13:06:23.013092 11782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } }
I20260806 13:06:23.013520 11878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.013629 11782 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:23.013648 11878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 13:06:23.016136 11889 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:23.016251 11889 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:23.016641 11714 master_runner.cc:186] Error getting master registration for 127.20.245.190:40437: OK, instance_id { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" instance_seqno: 1786021582565112 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 13:06:23.020447 11714 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 13:06:23.023008 11707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } attempt: 3
Aug 06 13:06:23 dist-test-slave-srgv krb5kdc[11625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021582, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:06:23.032768 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:23.023521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33365 (local address 127.0.0.1:44078)
0806 13:06:23.023616 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:23.023631 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:23.023695 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:23.024008 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:23.024010 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:23.024241 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:23.024313 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:23.024315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.025302 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.025303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:23.025894 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:23.025897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.026440 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.026441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:23.026529 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:23.027197 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:23.027207 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:23.029003 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:23.031383 (+ 2380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:23.031384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:23.031385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:23.031624 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:23.031891 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:23.031893 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:23.031893 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:23.031986 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:23.032328 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:23.032329 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:23.032407 (+ 78us) client_negotiation.cc:769] Sending connection context
0806 13:06:23.032486 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 13:06:23.032660 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 13:06:23.032763 11862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:23.023780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44078 (local address 127.20.245.188:33365)
0806 13:06:23.023863 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.023865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.023876 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:06:23.023915 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.023916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.023931 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.023996 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.024414 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.025216 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.026027 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.026344 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.026429 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:23.029136 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:23.029138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:23.029139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:23.029150 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:23.031277 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.031725 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.031726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.031727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.031804 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.032063 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.032064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.032064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.032257 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:23.032334 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:23.032525 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 13:06:23.032635 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 13:06:23.035858 11707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142: Bootstrap starting.
I20260806 13:06:23.036923 11707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:23.037358 11707 log.cc:824] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:23.038486 11707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142: No bootstrap required, opened a new log
I20260806 13:06:23.040367 11707 raft_consensus.cc:348] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } }
I20260806 13:06:23.040578 11707 raft_consensus.cc:729] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 123b7e1a072a48e1936c16c09cd4c142, State: Initialized, Role: FOLLOWER
I20260806 13:06:23.040690 11707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } }
I20260806 13:06:23.041158 11707 sys_catalog.cc:564] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:23.041183 11680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 13:06:23.041309 11680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:23.042564 11680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } }
I20260806 13:06:23.042953 11680 leader_election.cc:288] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [CANDIDATE]: Term 1 election: Requested vote from peers 82c7a712bc5342c382045018514bdf61 (127.20.245.189:34663), 70b0613070a0491ea6bd0dd525dc5460 (127.20.245.188:33365)
I20260806 13:06:23.044260 11756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "123b7e1a072a48e1936c16c09cd4c142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "82c7a712bc5342c382045018514bdf61"
I20260806 13:06:23.044458 11756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:23.045729 11756 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 123b7e1a072a48e1936c16c09cd4c142 in term 1.
I20260806 13:06:23.046099 11831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "123b7e1a072a48e1936c16c09cd4c142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "70b0613070a0491ea6bd0dd525dc5460"
I20260806 13:06:23.046334 11831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:23.049163 11657 leader_election.cc:302] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 123b7e1a072a48e1936c16c09cd4c142, 82c7a712bc5342c382045018514bdf61; no voters:
I20260806 13:06:23.051632 11831 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 123b7e1a072a48e1936c16c09cd4c142 in term 1.
I20260806 13:06:23.054087 11638 master_runner.cc:263] No leader master found from master 123b7e1a072a48e1936c16c09cd4c142
I20260806 13:06:23.054173 11638 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 13:06:23.043834 11903 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:23.054407 11903 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:23.041127 11892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.054728 11892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:23.054855 11892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:23.054993 11892 raft_consensus.cc:686] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [term 1 LEADER]: Becoming Leader. State: Replica: 123b7e1a072a48e1936c16c09cd4c142, State: Running, Role: LEADER
I20260806 13:06:23.055224 11892 consensus_queue.cc:237] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } }
I20260806 13:06:23.056151 11892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 123b7e1a072a48e1936c16c09cd4c142. Latest consensus state: current_term: 1 leader_uuid: "123b7e1a072a48e1936c16c09cd4c142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.056358 11892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:23.060350 11913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:23.061295 11913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260806 13:06:23.061949 11659 tablet.cc:2369] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:06:23.073175 11831 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [term 1 FOLLOWER]: Refusing update from remote peer 123b7e1a072a48e1936c16c09cd4c142: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:06:23.073762 11909 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:06:23.074770 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:23.056950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44256 (local address 127.20.245.190:40437)
0806 13:06:23.057011 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.057014 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.063310 (+ 6296us) server_negotiation.cc:407] Connection header received
0806 13:06:23.063643 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.063645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.063663 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.063702 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.065211 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.066098 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.067383 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.067764 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.067820 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:23.070281 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:23.070284 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:23.070284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:23.070297 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:23.072485 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.073031 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.073033 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.073034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.073123 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.073671 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.073673 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.073673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.073878 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:23.073995 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:23.074510 (+ 515us) server_negotiation.cc:299] Negotiation successful
0806 13:06:23.074637 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:06:23.076630 11864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 123b7e1a072a48e1936c16c09cd4c142. Latest consensus state: current_term: 1 leader_uuid: "123b7e1a072a48e1936c16c09cd4c142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.076766 11756 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [term 1 FOLLOWER]: Refusing update from remote peer 123b7e1a072a48e1936c16c09cd4c142: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:06:23.076814 11864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:23.077297 11909 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:06:23.079672 11878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 123b7e1a072a48e1936c16c09cd4c142. Latest consensus state: current_term: 1 leader_uuid: "123b7e1a072a48e1936c16c09cd4c142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.079828 11878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:23.080648 11862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:23.051683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.20.245.188:33365)
0806 13:06:23.051741 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.051744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.059460 (+ 7716us) server_negotiation.cc:407] Connection header received
0806 13:06:23.059811 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.059813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.059830 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.059865 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.062069 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.062911 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.067668 (+ 4757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.068011 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.068088 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:23.072801 (+ 4713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:23.072805 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:23.072805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:23.072817 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:23.074668 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.078729 (+ 4061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.078731 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.078732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.078816 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.079353 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.079354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.079355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.079538 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:23.079655 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:23.080396 (+ 741us) server_negotiation.cc:299] Negotiation successful
0806 13:06:23.080521 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 13:06:23.081743 11909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "123b7e1a072a48e1936c16c09cd4c142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.081885 11909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:23.081884 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:23.051955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56548 (local address 127.20.245.189:34663)
0806 13:06:23.052010 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.052012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.059608 (+ 7596us) server_negotiation.cc:407] Connection header received
0806 13:06:23.059955 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.059957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.059972 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.060003 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.063061 (+ 3058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.064206 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.066416 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:23.066751 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:23.066803 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:23.075941 (+ 9138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:23.075943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:23.075944 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:23.075957 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:23.078188 (+ 2231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.078908 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.078909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.078909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.078975 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:23.079878 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:23.079880 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:23.079880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:23.080043 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:23.080122 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:23.081670 (+ 1548us) server_negotiation.cc:299] Negotiation successful
0806 13:06:23.081781 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 13:06:23.082553 11878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "123b7e1a072a48e1936c16c09cd4c142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.082643 11878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:23.083146 11915 mvcc.cc:205] Tried to move back new op lower bound from 7315544404262416384 to 7315544404196429824. Current Snapshot: MvccSnapshot[applied={T|T < 7315544404262416384}]
I20260806 13:06:23.084075 11918 mvcc.cc:205] Tried to move back new op lower bound from 7315544404262416384 to 7315544404196429824. Current Snapshot: MvccSnapshot[applied={T|T < 7315544404262416384}]
I20260806 13:06:23.084288 11892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "123b7e1a072a48e1936c16c09cd4c142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.084405 11892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:23.084874 11864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "123b7e1a072a48e1936c16c09cd4c142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "123b7e1a072a48e1936c16c09cd4c142" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 40437 } } peers { permanent_uuid: "82c7a712bc5342c382045018514bdf61" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 34663 } } peers { permanent_uuid: "70b0613070a0491ea6bd0dd525dc5460" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33365 } } }
I20260806 13:06:23.084966 11864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:23.085005 11913 catalog_manager.cc:1347] Generated new cluster ID: 43de211b42454d6f8de0953e7596ad19
I20260806 13:06:23.085047 11913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:23.085762 11916 mvcc.cc:205] Tried to move back new op lower bound from 7315544404262416384 to 7315544404196429824. Current Snapshot: MvccSnapshot[applied={T|T < 7315544404262416384}]
I20260806 13:06:23.142993 11913 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:23.144450 11913 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:23.154925 11913 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 123b7e1a072a48e1936c16c09cd4c142: Generated new TSK 0
I20260806 13:06:23.155409 11913 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 13:06:23.190174 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.187757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56558 (local address 127.20.245.189:34663)
0806 13:06:23.187881 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.187886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.189140 (+ 1254us) server_negotiation.cc:407] Connection header received
0806 13:06:23.189305 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.189307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.189324 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.189364 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.190059 (+ 695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56558: BlockingRecv error: recv got EOF from 127.0.0.1:56558 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260806 13:06:23.192045 11862 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.188707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44092 (local address 127.20.245.188:33365)
0806 13:06:23.188780 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.188782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.190822 (+ 2040us) server_negotiation.cc:407] Connection header received
0806 13:06:23.190958 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.190960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.190978 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.191018 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.191944 (+ 926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44092: BlockingRecv error: recv got EOF from 127.0.0.1:44092 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260806 13:06:23.193948 11710 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.192744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44262 (local address 127.20.245.190:40437)
0806 13:06:23.192893 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.192895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.193155 (+ 260us) server_negotiation.cc:407] Connection header received
0806 13:06:23.193289 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.193291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.193307 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.193350 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.193840 (+ 490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44262: BlockingRecv error: recv got EOF from 127.0.0.1:44262 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260806 13:06:23.197803 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.196213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56560 (local address 127.20.245.189:34663)
0806 13:06:23.196270 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.196273 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.196642 (+ 369us) server_negotiation.cc:407] Connection header received
0806 13:06:23.197036 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.197039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.197071 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.197110 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.197703 (+ 593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56560: BlockingRecv error: recv got EOF from 127.0.0.1:56560 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260806 13:06:23.205816 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.204288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56574 (local address 127.20.245.189:34663)
0806 13:06:23.204387 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.204402 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.204933 (+ 531us) server_negotiation.cc:407] Connection header received
0806 13:06:23.205069 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.205071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.205089 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.205125 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.205721 (+ 596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56574: BlockingRecv error: recv got EOF from 127.0.0.1:56574 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260806 13:06:23.211552 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.210267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56584 (local address 127.20.245.189:34663)
0806 13:06:23.210330 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.210333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.210729 (+ 396us) server_negotiation.cc:407] Connection header received
0806 13:06:23.210858 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.210860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.210876 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.210912 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.211473 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56584: BlockingRecv error: recv got EOF from 127.0.0.1:56584 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260806 13:06:23.218802 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.217506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56598 (local address 127.20.245.189:34663)
0806 13:06:23.217565 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.217568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.217972 (+ 404us) server_negotiation.cc:407] Connection header received
0806 13:06:23.218107 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.218109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.218125 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.218160 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.218705 (+ 545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56598: BlockingRecv error: recv got EOF from 127.0.0.1:56598 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260806 13:06:23.230952 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.229235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56604 (local address 127.20.245.189:34663)
0806 13:06:23.229307 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.229310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.229965 (+ 655us) server_negotiation.cc:407] Connection header received
0806 13:06:23.230115 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.230117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.230135 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.230177 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.230828 (+ 651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56604: BlockingRecv error: recv got EOF from 127.0.0.1:56604 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260806 13:06:23.252040 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.250117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56618 (local address 127.20.245.189:34663)
0806 13:06:23.250222 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.250225 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.250735 (+ 510us) server_negotiation.cc:407] Connection header received
0806 13:06:23.250882 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.250883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.250902 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.250943 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.251903 (+ 960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56618: BlockingRecv error: recv got EOF from 127.0.0.1:56618 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 13:06:23.287528 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.286615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56620 (local address 127.20.245.189:34663)
0806 13:06:23.286730 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.286733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.286782 (+ 49us) server_negotiation.cc:407] Connection header received
0806 13:06:23.286860 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.286861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.286877 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.286964 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.287438 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56620: BlockingRecv error: recv got EOF from 127.0.0.1:56620 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 13:06:23.354317 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.353403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56626 (local address 127.20.245.189:34663)
0806 13:06:23.353500 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.353502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.353514 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:06:23.353552 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.353553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.353566 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.353651 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.354192 (+ 541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56626: BlockingRecv error: recv got EOF from 127.0.0.1:56626 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 13:06:23.485152 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.484258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56636 (local address 127.20.245.189:34663)
0806 13:06:23.484363 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.484365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.484443 (+ 78us) server_negotiation.cc:407] Connection header received
0806 13:06:23.484521 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.484523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.484535 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.484583 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.485043 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56636: BlockingRecv error: recv got EOF from 127.0.0.1:56636 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260806 13:06:23.743767 11786 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:23.742828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56646 (local address 127.20.245.189:34663)
0806 13:06:23.742922 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:23.742924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:23.742941 (+ 17us) server_negotiation.cc:407] Connection header received
0806 13:06:23.743035 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:23.743036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:23.743048 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:23.743152 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:23.743676 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56646: BlockingRecv error: recv got EOF from 127.0.0.1:56646 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 13:06:23.996619 11875 catalog_manager.cc:1259] Loaded cluster ID: 43de211b42454d6f8de0953e7596ad19
I20260806 13:06:23.996747 11875 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460: loading cluster ID for follower catalog manager: success
I20260806 13:06:23.997846 11875 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460: acquiring CA information for follower catalog manager: success
I20260806 13:06:23.998346 11875 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 70b0613070a0491ea6bd0dd525dc5460: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 13:06:24.016927 11889 catalog_manager.cc:1259] Loaded cluster ID: 43de211b42454d6f8de0953e7596ad19
I20260806 13:06:24.017047 11889 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61: loading cluster ID for follower catalog manager: success
I20260806 13:06:24.018214 11889 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61: acquiring CA information for follower catalog manager: success
I20260806 13:06:24.018652 11889 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 82c7a712bc5342c382045018514bdf61: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 13:06:24.261194 11988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:24.257637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56648 (local address 127.20.245.189:34663)
0806 13:06:24.257843 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:24.257846 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:24.257859 (+ 13us) server_negotiation.cc:407] Connection header received
0806 13:06:24.257918 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:24.257919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:24.258007 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:24.258105 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:24.258389 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.259048 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.260048 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.260350 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.260424 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:24.260667 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:24.260822 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:24.260896 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:24.260971 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 13:06:24.261002 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":137,"threads_started":1}
I20260806 13:06:24.266479 11994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:24.263577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44100 (local address 127.20.245.188:33365)
0806 13:06:24.263740 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:24.263743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:24.263753 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:06:24.263857 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:24.263858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:24.263916 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:24.264008 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:24.264150 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.264707 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.265529 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.265761 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.265846 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:24.266032 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:24.266201 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:24.266299 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:24.266325 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 13:06:24.266351 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260806 13:06:24.271883 11988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:24.268634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56658 (local address 127.20.245.189:34663)
0806 13:06:24.268695 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:24.268699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:24.269048 (+ 349us) server_negotiation.cc:407] Connection header received
0806 13:06:24.269130 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:24.269131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:24.269147 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:24.269204 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:24.269405 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.269928 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.271054 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.271324 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.271415 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:24.271563 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:24.271601 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:24.271649 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:24.271753 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 13:06:24.271783 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 13:06:24.272403 12002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:24.268778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44274 (local address 127.20.245.190:40437)
0806 13:06:24.268907 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:24.268910 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:24.268919 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:06:24.268994 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:24.268995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:24.269078 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:24.269246 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:24.269579 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.270143 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.271002 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.271391 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.271461 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:24.271738 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:24.271900 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:24.272256 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:24.272278 (+ 22us) server_negotiation.cc:299] Negotiation successful
0806 13:06:24.272314 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":69,"threads_started":1}
I20260806 13:06:24.273670 11994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:24.268858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44110 (local address 127.20.245.188:33365)
0806 13:06:24.268908 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:24.268910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:24.269001 (+ 91us) server_negotiation.cc:407] Connection header received
0806 13:06:24.269092 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:24.269093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:24.269107 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:24.269158 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:24.270041 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.270851 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.272403 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:24.272693 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:24.272777 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:24.273069 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:24.273110 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:24.273174 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:24.273543 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 13:06:24.273578 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 13:06:24.274587 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 11638
I20260806 13:06:24.285943 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 11714
I20260806 13:06:24.293166 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 11789
2026-08-06T13:06:24Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3186 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 13:06:24 dist-test-slave-srgv krb5kdc[12007](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 13:06:24 dist-test-slave-srgv krb5kdc[12007](info): set up 2 sockets
Aug 06 13:06:24 dist-test-slave-srgv krb5kdc[12007](info): commencing operation
krb5kdc: starting...
W20260806 13:06:25.393741 21462 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/test-user.keytab.
Aug 06 13:06:25 dist-test-slave-srgv krb5kdc[12007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T13:06:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T13:06:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.245.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
Entry for principal kudu/127.20.245.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab.
I20260806 13:06:25.543960 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33537
--webserver_interface=127.20.245.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:33537,127.20.245.189:33487,127.20.245.188:33957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 13:06:25.651962 12020 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 13:06:25.652288 12020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:25.652309 12020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:25.652367 12020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:25.653867 12020 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:25.653928 12020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:25.653944 12020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:25.653957 12020 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:25.653970 12020 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:25.655858 12020 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:33537,127.20.245.189:33487,127.20.245.188:33957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.190.keytab
--principal=kudu/127.20.245.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.190:33537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.245.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:25.656203 12020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:25.656512 12020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:25.662559 12025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:25.662569 12026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:25.662559 12028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:25.663108 12020 server_base.cc:1034] running on GCE node
I20260806 13:06:25.663502 12020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:25.663980 12020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:25.665162 12020 hybrid_clock.cc:648] HybridClock initialized: now 1786021585665110 us; error 72 us; skew 500 ppm
Aug 06 13:06:25 dist-test-slave-srgv krb5kdc[12007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:25.676857 12020 init.cc:377] Logged in from keytab as kudu/127.20.245.190@KRBTEST.COM (short username kudu)
I20260806 13:06:25.677547 12020 webserver.cc:460] Webserver started at http://127.20.245.190:32869/ using document root <none> and password file <none>
I20260806 13:06:25.677857 12020 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:25.677939 12020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:25.678118 12020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:25.679654 12020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/data/instance:
uuid: "9b7b42e8a5e44ba4b19725eaa5261a31"
format_stamp: "Formatted at 2026-08-06 13:06:25 on dist-test-slave-srgv"
server_key: "a1f249c8a8417311b17d4e1e5de719d9"
server_key_iv: "3d83b2a742eb425a96e6eac166750702"
server_key_version: "encryptionkey@0"
I20260806 13:06:25.680112 12020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/wal/instance:
uuid: "9b7b42e8a5e44ba4b19725eaa5261a31"
format_stamp: "Formatted at 2026-08-06 13:06:25 on dist-test-slave-srgv"
server_key: "a1f249c8a8417311b17d4e1e5de719d9"
server_key_iv: "3d83b2a742eb425a96e6eac166750702"
server_key_version: "encryptionkey@0"
I20260806 13:06:25.681923 12020 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 13:06:25.683017 12035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:25.683362 12020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:25.683494 12020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/wal
uuid: "9b7b42e8a5e44ba4b19725eaa5261a31"
format_stamp: "Formatted at 2026-08-06 13:06:25 on dist-test-slave-srgv"
server_key: "a1f249c8a8417311b17d4e1e5de719d9"
server_key_iv: "3d83b2a742eb425a96e6eac166750702"
server_key_version: "encryptionkey@0"
I20260806 13:06:25.683595 12020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:25.698850 12020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:25.701951 12020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:25.702158 12020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:25.707535 12020 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.190:33537
I20260806 13:06:25.707592 12087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.190:33537 every 8 connection(s)
I20260806 13:06:25.708083 12020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/data/info.pb
I20260806 13:06:25.709300 12088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:25.711469 12088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:25.712191 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 12020
I20260806 13:06:25.712287 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-0/wal/instance
I20260806 13:06:25.712546 21462 external_mini_cluster.cc:1428] Setting key 8bd863e2826b593b9b57643477cd33f3
Aug 06 13:06:25 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.245.189@KRBTEST.COM; defaulting to no policy
I20260806 13:06:25.725638 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.712556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33537 (local address 127.0.0.1:52788)
0806 13:06:25.712820 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.712890 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:25.713820 (+ 930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:25.714160 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:25.714163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:25.714637 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:25.714935 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:25.714941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.716662 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.716664 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:25.717900 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:25.717905 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.718545 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.718547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:25.718650 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:25.719459 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:25.719473 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:25.721540 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:25.723841 (+ 2301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:25.723849 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:25.723852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:25.724079 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:25.724398 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:25.724398 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:25.724399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:25.724499 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:25.724922 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:25.724928 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:25.724997 (+ 69us) client_negotiation.cc:769] Sending connection context
0806 13:06:25.725115 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 13:06:25.725391 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":94,"thread_start_us":118,"threads_started":1}
I20260806 13:06:25.725646 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.712815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52788 (local address 127.20.245.190:33537)
0806 13:06:25.712960 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:25.712966 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:25.713005 (+ 39us) server_negotiation.cc:407] Connection header received
0806 13:06:25.713999 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:25.714000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:25.714021 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:25.714113 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:25.715053 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.716428 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.718010 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.718439 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.718535 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:25.721654 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:25.721663 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:25.721668 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:25.721677 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:25.723727 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:25.724169 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:25.724173 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:25.724174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:25.724319 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:25.724570 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:25.724571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:25.724572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:25.724851 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:25.724952 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:25.725151 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 13:06:25.725320 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.189@KRBTEST.COM" created.
I20260806 13:06:25.726902 12088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:25.727470 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.727292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58186)
0806 13:06:25.727355 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.727423 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260806 13:06:25.727638 12037 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
I20260806 13:06:25.728190 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.728061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58188)
0806 13:06:25.728116 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.728156 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260806 13:06:25.728320 12088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:33487: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab.
Entry for principal kudu/127.20.245.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab.
I20260806 13:06:25.747866 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.189:33487
--webserver_interface=127.20.245.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab
--principal=kudu/127.20.245.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:33537,127.20.245.189:33487,127.20.245.188:33957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 13:06:25.777647 12088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } attempt: 1
I20260806 13:06:25.778528 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.778249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58200)
0806 13:06:25.778412 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.778475 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260806 13:06:25.779028 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.778927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58216)
0806 13:06:25.778973 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.779004 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 13:06:25.779222 12088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:33487: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
I20260806 13:06:25.847426 12088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } attempt: 2
I20260806 13:06:25.848192 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.848022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58228)
0806 13:06:25.848099 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.848142 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 13:06:25.848585 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.848502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58232)
0806 13:06:25.848538 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.848563 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260806 13:06:25.848685 12088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.189:33487: Network error: Client connection negotiation failed: client connection to 127.20.245.189:33487: connect: Connection refused (error 111)
W20260806 13:06:25.853986 12095 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 13:06:25.854331 12095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:25.854353 12095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:25.854384 12095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:25.856086 12095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:25.856169 12095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:25.856185 12095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:25.856199 12095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:25.856213 12095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:25.858340 12095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:33537,127.20.245.189:33487,127.20.245.188:33957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.189.keytab
--principal=kudu/127.20.245.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.189:33487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.245.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:25.858721 12095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:25.859027 12095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 13:06:25.865121 12103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:25.865242 12095 server_base.cc:1034] running on GCE node
W20260806 13:06:25.865099 12101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:25.865093 12100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:25.865696 12095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:25.866065 12095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:25.867274 12095 hybrid_clock.cc:648] HybridClock initialized: now 1786021585867254 us; error 32 us; skew 500 ppm
Aug 06 13:06:25 dist-test-slave-srgv krb5kdc[12007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:25.870579 12095 init.cc:377] Logged in from keytab as kudu/127.20.245.189@KRBTEST.COM (short username kudu)
I20260806 13:06:25.871308 12095 webserver.cc:460] Webserver started at http://127.20.245.189:44479/ using document root <none> and password file <none>
I20260806 13:06:25.871613 12095 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:25.871701 12095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:25.871886 12095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:25.873347 12095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/data/instance:
uuid: "6e21123e722444dc8fb3438372d3067f"
format_stamp: "Formatted at 2026-08-06 13:06:25 on dist-test-slave-srgv"
server_key: "b321e0ca07f77f32267745f698ad1919"
server_key_iv: "0d1887a9b1995c1d07d7739b2a2d1765"
server_key_version: "encryptionkey@0"
I20260806 13:06:25.873826 12095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/wal/instance:
uuid: "6e21123e722444dc8fb3438372d3067f"
format_stamp: "Formatted at 2026-08-06 13:06:25 on dist-test-slave-srgv"
server_key: "b321e0ca07f77f32267745f698ad1919"
server_key_iv: "0d1887a9b1995c1d07d7739b2a2d1765"
server_key_version: "encryptionkey@0"
I20260806 13:06:25.875865 12095 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260806 13:06:25.876928 12110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:25.877240 12095 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:25.877379 12095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/wal
uuid: "6e21123e722444dc8fb3438372d3067f"
format_stamp: "Formatted at 2026-08-06 13:06:25 on dist-test-slave-srgv"
server_key: "b321e0ca07f77f32267745f698ad1919"
server_key_iv: "0d1887a9b1995c1d07d7739b2a2d1765"
server_key_version: "encryptionkey@0"
I20260806 13:06:25.877483 12095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:25.889549 12095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:25.892592 12095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:25.892810 12095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:25.898025 12095 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.189:33487
I20260806 13:06:25.898069 12163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.189:33487 every 8 connection(s)
I20260806 13:06:25.898582 12095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/data/info.pb
I20260806 13:06:25.899900 12164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:25.901954 12164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:25.906138 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 12095
I20260806 13:06:25.906257 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-1/wal/instance
I20260806 13:06:25.906497 21462 external_mini_cluster.cc:1428] Setting key 990bcae02ddd55180c5d6fdcb2873333
Aug 06 13:06:25 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:06:25.914299 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.903018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52794 (local address 127.20.245.190:33537)
0806 13:06:25.903235 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:25.903237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:25.903402 (+ 165us) server_negotiation.cc:407] Connection header received
0806 13:06:25.904100 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:25.904102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:25.904123 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:25.904187 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:25.904988 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.905568 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.906797 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.907040 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.907153 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:25.910308 (+ 3155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:25.910310 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:25.910311 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:25.910331 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:25.912391 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:25.912964 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:25.912967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:25.912967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:25.913047 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:25.913424 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:25.913425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:25.913425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:25.913590 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:25.913672 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:25.914044 (+ 372us) server_negotiation.cc:299] Negotiation successful
0806 13:06:25.914169 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 13:06:25.914589 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.902949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33537 (local address 127.0.0.1:52794)
0806 13:06:25.903234 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.903300 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:25.903957 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:25.904292 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:25.904296 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:25.904635 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:25.904888 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:25.904891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.905683 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.905684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:25.906705 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:25.906708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.907202 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.907203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:25.907352 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:25.908013 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:25.908023 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:25.910152 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:25.912520 (+ 2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:25.912540 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:25.912543 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:25.912872 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:25.913139 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:25.913140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:25.913140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:25.913345 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:25.913674 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:25.913686 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:25.913883 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 13:06:25.914010 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 13:06:25.914245 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":116,"threads_started":1}
I20260806 13:06:25.915405 12164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.245.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.245.188@KRBTEST.COM" created.
Aug 06 13:06:25 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:06:25.925426 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.915967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58244 (local address 127.20.245.189:33487)
0806 13:06:25.916287 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:25.916292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:25.916355 (+ 63us) server_negotiation.cc:407] Connection header received
0806 13:06:25.916394 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:25.916397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:25.916414 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:25.916504 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:25.916929 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.917733 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.918518 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.918952 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.919076 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:25.921621 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:25.921639 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:25.921639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:25.921657 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:25.923847 (+ 2190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:25.924371 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:25.924375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:25.924376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:25.924445 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:25.924688 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:25.924689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:25.924689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:25.924904 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:25.924979 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:25.925171 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 13:06:25.925307 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":276,"thread_start_us":191,"threads_started":1}
I20260806 13:06:25.925583 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.915868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58244)
0806 13:06:25.916250 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.916267 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:25.916332 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:25.916524 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:25.916525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:25.916739 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:25.916839 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:25.916843 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.917835 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.917836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:25.918421 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:25.918423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.919077 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.919078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:25.919189 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:25.919765 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:25.919801 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:25.921510 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:25.923957 (+ 2447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:25.923959 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:25.923959 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:25.924245 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:25.924524 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:25.924525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:25.924525 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:25.924618 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:25.924974 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:25.924975 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:25.925038 (+ 63us) client_negotiation.cc:769] Sending connection context
0806 13:06:25.925130 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 13:06:25.925403 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":112}
I20260806 13:06:25.926695 12164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:25.927240 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.927033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:46958)
0806 13:06:25.927097 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.927196 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260806 13:06:25.927481 12114 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
I20260806 13:06:25.928097 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.927968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:46964)
0806 13:06:25.928027 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.928066 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 13:06:25.928241 12164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33957: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
I20260806 13:06:25.939875 12088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.245.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab.
Entry for principal kudu/127.20.245.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab.
I20260806 13:06:25.944150 21462 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJGA6C/build/release/bin/kudu
/tmp/dist-test-taskGJGA6C/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.188:33957
--webserver_interface=127.20.245.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab
--principal=kudu/127.20.245.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.245.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.245.190:33537,127.20.245.189:33487,127.20.245.188:33957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 13:06:25 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:06:25.949837 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.940481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58260)
0806 13:06:25.940566 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.940582 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:25.940670 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:25.940875 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:25.940876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:25.941098 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:25.941204 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:25.941207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.942171 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.942174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:25.942828 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:25.942831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.943469 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.943471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:25.943596 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:25.944218 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:25.944224 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:25.946044 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:25.948431 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:25.948433 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:25.948433 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:25.948717 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:25.948967 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:25.948968 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:25.948969 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:25.949032 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:25.949410 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:25.949412 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:25.949470 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 13:06:25.949548 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 13:06:25.949730 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 13:06:25.949893 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.940641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58260 (local address 127.20.245.189:33487)
0806 13:06:25.940714 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:25.940716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:25.940728 (+ 12us) server_negotiation.cc:407] Connection header received
0806 13:06:25.940774 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:25.940775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:25.940789 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:25.940868 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:25.941355 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.942055 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.942936 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:25.943332 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:25.943417 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:25.946175 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:25.946184 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:25.946184 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:25.946198 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:25.948302 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:25.948810 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:25.948812 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:25.948813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:25.948892 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:25.949101 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:25.949103 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:25.949103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:25.949313 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:25.949400 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:25.949601 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 13:06:25.949721 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 13:06:25.950479 12088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:25.950982 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.950852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:46966)
0806 13:06:25.950911 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.950950 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 13:06:25.951463 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.951371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:46980)
0806 13:06:25.951416 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.951444 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 13:06:25.951584 12088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33957: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
I20260806 13:06:25.977644 12164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } attempt: 1
I20260806 13:06:25.978602 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.978281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:46982)
0806 13:06:25.978487 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.978552 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
I20260806 13:06:25.979127 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.979002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:46994)
0806 13:06:25.979063 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.979101 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260806 13:06:25.979405 12164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33957: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
I20260806 13:06:25.982734 12088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } attempt: 1
I20260806 13:06:25.983325 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.983141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47010)
0806 13:06:25.983233 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.983282 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 13:06:25.983774 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:25.983678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47014)
0806 13:06:25.983726 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:25.983752 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 13:06:25.983883 12088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33957: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
I20260806 13:06:26.047655 12164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } attempt: 2
I20260806 13:06:26.048393 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.048206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47020)
0806 13:06:26.048294 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.048347 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 13:06:26.048823 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.048718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47026)
0806 13:06:26.048766 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.048801 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 13:06:26.048920 12164 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33957: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
W20260806 13:06:26.053094 12171 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 13:06:26.053375 12171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 13:06:26.053397 12171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 13:06:26.053457 12171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 13:06:26.054960 12171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 13:06:26.055015 12171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 13:06:26.055032 12171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 13:06:26.055047 12171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 13:06:26.055089 12171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 13:06:26.057147 12171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.245.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.245.190:33537,127.20.245.189:33487,127.20.245.188:33957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/krb5kdc/kudu_127.20.245.188.keytab
--principal=kudu/127.20.245.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.245.188:33957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.245.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 11:44:25 UTC on ccycloud.quasar-gzggqh.root.comops.site
build id 4570062
I20260806 13:06:26.057526 12171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 13:06:26.058022 12171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 13:06:26.059051 12088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } attempt: 2
I20260806 13:06:26.059782 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.059571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47036)
0806 13:06:26.059668 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.059731 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 13:06:26.060257 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.060150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47042)
0806 13:06:26.060203 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.060230 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 13:06:26.060380 12088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.245.188:33957: Network error: Client connection negotiation failed: client connection to 127.20.245.188:33957: connect: Connection refused (error 111)
W20260806 13:06:26.065088 12177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:26.065099 12171 server_base.cc:1034] running on GCE node
W20260806 13:06:26.065074 12179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 13:06:26.065071 12176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 13:06:26.065687 12171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 13:06:26.066110 12171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 13:06:26.067255 12171 hybrid_clock.cc:648] HybridClock initialized: now 1786021586067219 us; error 62 us; skew 500 ppm
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021586, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 13:06:26.070649 12171 init.cc:377] Logged in from keytab as kudu/127.20.245.188@KRBTEST.COM (short username kudu)
I20260806 13:06:26.071343 12171 webserver.cc:460] Webserver started at http://127.20.245.188:33069/ using document root <none> and password file <none>
I20260806 13:06:26.071660 12171 fs_manager.cc:359] Metadata directory not provided
I20260806 13:06:26.071733 12171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 13:06:26.071914 12171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 13:06:26.073325 12171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/data/instance:
uuid: "7025cc09118448b4af20727b1a4420f5"
format_stamp: "Formatted at 2026-08-06 13:06:26 on dist-test-slave-srgv"
server_key: "00cb702b1cfc60873fea80b2e907eefa"
server_key_iv: "ad12e16626ed53fbfe6a515305fb1448"
server_key_version: "encryptionkey@0"
I20260806 13:06:26.073779 12171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/wal/instance:
uuid: "7025cc09118448b4af20727b1a4420f5"
format_stamp: "Formatted at 2026-08-06 13:06:26 on dist-test-slave-srgv"
server_key: "00cb702b1cfc60873fea80b2e907eefa"
server_key_iv: "ad12e16626ed53fbfe6a515305fb1448"
server_key_version: "encryptionkey@0"
I20260806 13:06:26.075647 12171 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 13:06:26.076871 12186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 13:06:26.077133 12171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 13:06:26.077260 12171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/wal
uuid: "7025cc09118448b4af20727b1a4420f5"
format_stamp: "Formatted at 2026-08-06 13:06:26 on dist-test-slave-srgv"
server_key: "00cb702b1cfc60873fea80b2e907eefa"
server_key_iv: "ad12e16626ed53fbfe6a515305fb1448"
server_key_version: "encryptionkey@0"
I20260806 13:06:26.077402 12171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 13:06:26.096063 12171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 13:06:26.099607 12171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 13:06:26.099865 12171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 13:06:26.105960 12171 rpc_server.cc:307] RPC server started. Bound to: 127.20.245.188:33957
I20260806 13:06:26.106110 12238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.245.188:33957 every 8 connection(s)
I20260806 13:06:26.106622 12171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/data/info.pb
I20260806 13:06:26.107986 12239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 13:06:26.110224 12239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:26.113036 21462 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJGA6C/build/release/bin/kudu as pid 12171
I20260806 13:06:26.113204 21462 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJGA6C/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786021275077601-21462-0/minicluster-data/master-2/wal/instance
I20260806 13:06:26.113492 21462 external_mini_cluster.cc:1428] Setting key 2ae15a0136d64aad15c0aa98c32dc4d0
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021586, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:06:26.123739 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.111315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.190:33537 (local address 127.0.0.1:52800)
0806 13:06:26.111597 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.111692 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:26.112358 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:26.112842 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:26.112849 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:26.113393 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:26.113790 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.113797 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.114916 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.114918 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.116471 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.116474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.116912 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.116914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.117052 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.117754 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:26.117764 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:26.119820 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:26.121762 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.121771 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.121774 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.122109 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.122360 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.122361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.122361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.122500 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.122805 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:26.122813 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:26.122997 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 13:06:26.123116 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 13:06:26.123368 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":163,"threads_started":1}
I20260806 13:06:26.123872 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.111423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52800 (local address 127.20.245.190:33537)
0806 13:06:26.111512 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.111516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.111826 (+ 310us) server_negotiation.cc:407] Connection header received
0806 13:06:26.112542 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.112544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.112560 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.112636 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.113917 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.114789 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.116569 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.116784 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.116886 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.119943 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.119946 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.119946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.119958 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.121663 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.122219 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.122220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.122220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.122287 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.122581 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.122582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.122582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.122735 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.122819 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.123641 (+ 822us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.123752 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 13:06:26.124431 12243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.114047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47058 (local address 127.20.245.188:33957)
0806 13:06:26.114311 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.114322 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.114464 (+ 142us) server_negotiation.cc:407] Connection header received
0806 13:06:26.114520 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.114522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.114544 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.114665 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.115537 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.116781 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.117584 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.117938 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.118032 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.120831 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.120859 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.120859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.120870 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.122535 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.122932 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.122936 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.122936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.122998 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.123267 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.123268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.123268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.123425 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.123632 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.123686 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.123780 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":147,"threads_started":1}
I20260806 13:06:26.124455 12239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021586, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.190@KRBTEST.COM
I20260806 13:06:26.135037 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.124889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58272 (local address 127.20.245.189:33487)
0806 13:06:26.124967 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.124970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.124979 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:06:26.125010 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.125012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.125026 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.125085 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.125618 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.126217 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.126985 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.127334 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.127430 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.130111 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.130114 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.130114 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.130126 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.133225 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.133817 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.133819 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.133820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.133895 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.134218 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.134220 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.134220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.134467 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.134556 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.134823 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.134929 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 13:06:26.135037 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.124777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.189:33487 (local address 127.0.0.1:58272)
0806 13:06:26.124828 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.124839 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:26.124880 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:26.125223 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:26.125224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:26.125436 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:26.125528 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.125532 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.126311 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.126313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.126887 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.126889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.127424 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.127425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.127510 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.128060 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:26.128074 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:26.129938 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:26.133372 (+ 3434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.133375 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.133376 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.133662 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.133992 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.133993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.133994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.134077 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.134600 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:26.134601 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:26.134674 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 13:06:26.134755 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 13:06:26.134908 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 13:06:26.136160 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.125502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52808 (local address 127.20.245.190:33537)
0806 13:06:26.125548 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.125550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.125558 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:06:26.125581 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.125582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.125593 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.125644 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.126195 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.126716 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.127532 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.127803 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.127881 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.130843 (+ 2962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.130846 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.130847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.130859 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.134161 (+ 3302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.134622 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.134623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.134624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.134696 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.134899 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.134900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.134900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.135040 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.135390 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.135815 (+ 425us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.135930 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 13:06:26.136312 12239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } has no permanent_uuid. Determining permanent_uuid...
I20260806 13:06:26.140077 12164 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } attempt: 3
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021586, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.188@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.245.189@KRBTEST.COM
I20260806 13:06:26.145473 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.136723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47062)
0806 13:06:26.136781 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.136795 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:26.136847 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:26.137146 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:26.137147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:26.137331 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:26.137381 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.137383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.138140 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.138141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.138742 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.138744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.139163 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.139164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.139250 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.139941 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:26.139946 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:26.142208 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:26.144348 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.144349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.144350 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.144538 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.144756 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.144757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.144757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.144816 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.145077 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:26.145078 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:26.145120 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 13:06:26.145199 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 13:06:26.145326 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.189@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:06:26.145473 12243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.136755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47062 (local address 127.20.245.188:33957)
0806 13:06:26.136801 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.136803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.136831 (+ 28us) server_negotiation.cc:407] Connection header received
0806 13:06:26.137063 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.137065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.137079 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.137135 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.137459 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.138063 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.138827 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.139094 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.139148 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.142305 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.142307 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.142308 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.142316 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.144244 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.144625 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.144626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.144627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.144684 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.144878 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.144879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.144880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.145005 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.145076 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.145229 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.145373 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":76,"server-negotiator.queue_time_us":26}
I20260806 13:06:26.146375 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.136860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58286 (local address 127.20.245.189:33487)
0806 13:06:26.136905 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.136907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.136915 (+ 8us) server_negotiation.cc:407] Connection header received
0806 13:06:26.136941 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.136942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.136953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.137009 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.137625 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.138178 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.138904 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.139104 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.139231 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.142522 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.142523 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.142523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.142532 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.144714 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.145201 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.145202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.145203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.145265 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.145490 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.145491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.145491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.145626 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.145873 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.146141 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.146259 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 13:06:26.148665 21462 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 13:06:26.148665 12239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5: Bootstrap starting.
I20260806 13:06:26.149724 12239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:26.149955 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.140432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47072)
0806 13:06:26.140499 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.140512 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:26.140554 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:26.140889 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:26.140890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:26.141084 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:26.141147 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.141150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.142209 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.142210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.143021 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.143024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.143612 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.143613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.143682 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.144084 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:26.144090 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:26.145962 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:26.148627 (+ 2665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.148628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.148629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.148881 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.149129 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.149130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.149130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.149202 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.149559 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:26.149560 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:26.149619 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 13:06:26.149694 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 13:06:26.149832 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 13:06:26.150120 12239 log.cc:824] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:26.150347 12244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.140492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47072 (local address 127.20.245.188:33957)
0806 13:06:26.140718 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.140721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.140728 (+ 7us) server_negotiation.cc:407] Connection header received
0806 13:06:26.140751 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.140752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.140777 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.140856 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.141249 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.142099 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.143110 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.143485 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.143861 (+ 376us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.146045 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.146047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.146047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.146056 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.148529 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.148968 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.148969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.148969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.149042 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.149290 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.149291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.149292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.149480 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.149558 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.150088 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.150188 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":148,"threads_started":1}
I20260806 13:06:26.151285 12239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5: No bootstrap required, opened a new log
I20260806 13:06:26.149902 12062 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52808
I20260806 13:06:26.152133 12164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f: Bootstrap starting.
I20260806 13:06:26.152902 12164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:26.153241 12164 log.cc:824] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:26.153765 12239 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } }
I20260806 13:06:26.153971 12239 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7025cc09118448b4af20727b1a4420f5, State: Initialized, Role: FOLLOWER
I20260806 13:06:26.154086 12239 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } }
I20260806 13:06:26.154247 12164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f: No bootstrap required, opened a new log
I20260806 13:06:26.154488 12239 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:26.154428 12247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.154564 12247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:26.156711 12164 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } }
I20260806 13:06:26.156899 12164 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e21123e722444dc8fb3438372d3067f, State: Initialized, Role: FOLLOWER
I20260806 13:06:26.156999 12164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } }
W20260806 13:06:26.157395 12258 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 13:06:26.157440 12164 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [sys.catalog]: configured and running, proceeding with master startup.
W20260806 13:06:26.157466 12258 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:26.159364 12260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.159550 12088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } attempt: 3
I20260806 13:06:26.157431 12171 master_runner.cc:186] Error getting master registration for 127.20.245.190:33537: OK, instance_id { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" instance_seqno: 1786021585705892 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 13:06:26.161592 12171 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 13:06:26.159476 12260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [sys.catalog]: This master's current role is: FOLLOWER
W20260806 13:06:26.160056 12271 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:26.163478 12271 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:26.159978 12095 master_runner.cc:186] Error getting master registration for 127.20.245.190:33537: OK, instance_id { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" instance_seqno: 1786021585705892 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 13:06:26.163625 12095 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 13:06:26 dist-test-slave-srgv krb5kdc[12007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786021585, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.245.190@KRBTEST.COM for kudu/127.20.245.188@KRBTEST.COM
I20260806 13:06:26.173187 12244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.163142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47084 (local address 127.20.245.188:33957)
0806 13:06:26.163246 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.163249 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.163258 (+ 9us) server_negotiation.cc:407] Connection header received
0806 13:06:26.163300 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.163301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.163315 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.163378 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.163886 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.164708 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.165824 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.166202 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.166306 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.169452 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.169455 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.169456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.169468 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.171603 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.172152 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.172153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.172154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.172232 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.172494 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.172494 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.172495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.172691 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.172769 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.172950 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.173061 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 13:06:26.173187 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.159870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.245.188:33957 (local address 127.0.0.1:47084)
0806 13:06:26.162898 (+ 3028us) negotiation.cc:107] Waiting for socket to connect
0806 13:06:26.162922 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 13:06:26.163022 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 13:06:26.163415 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 13:06:26.163416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 13:06:26.163689 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0806 13:06:26.163773 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.163776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.164814 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.164816 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.165704 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 13:06:26.165709 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.166389 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.166390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 13:06:26.166468 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.167248 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 13:06:26.167255 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 13:06:26.169254 (+ 1999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 13:06:26.171738 (+ 2484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.171741 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.171741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.172030 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.172312 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 13:06:26.172313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 13:06:26.172314 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 13:06:26.172427 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 13:06:26.172761 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 13:06:26.172762 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 13:06:26.172831 (+ 69us) client_negotiation.cc:769] Sending connection context
0806 13:06:26.172910 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 13:06:26.173064 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2984}
I20260806 13:06:26.175935 12088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31: Bootstrap starting.
I20260806 13:06:26.176918 12088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31: Neither blocks nor log segments found. Creating new log.
I20260806 13:06:26.177304 12088 log.cc:824] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31: Log is configured to *not* fsync() on all Append() calls
I20260806 13:06:26.178673 12088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31: No bootstrap required, opened a new log
I20260806 13:06:26.181561 12088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } }
I20260806 13:06:26.181862 12088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b7b42e8a5e44ba4b19725eaa5261a31, State: Initialized, Role: FOLLOWER
I20260806 13:06:26.182008 12088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } }
I20260806 13:06:26.182515 12274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.182714 12088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 13:06:26.182700 12062 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 13:06:26.182857 12062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:26.182698 12274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:26.183944 12062 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } }
I20260806 13:06:26.184309 12062 leader_election.cc:288] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [CANDIDATE]: Term 1 election: Requested vote from peers 6e21123e722444dc8fb3438372d3067f (127.20.245.189:33487), 7025cc09118448b4af20727b1a4420f5 (127.20.245.188:33957)
I20260806 13:06:26.184942 12138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6e21123e722444dc8fb3438372d3067f"
I20260806 13:06:26.185130 12138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:26.186394 12138 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b7b42e8a5e44ba4b19725eaa5261a31 in term 1.
I20260806 13:06:26.186815 12037 leader_election.cc:302] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e21123e722444dc8fb3438372d3067f, 9b7b42e8a5e44ba4b19725eaa5261a31; no voters:
I20260806 13:06:26.187364 12213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7025cc09118448b4af20727b1a4420f5"
I20260806 13:06:26.187548 12213 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 13:06:26.189198 12213 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b7b42e8a5e44ba4b19725eaa5261a31 in term 1.
W20260806 13:06:26.191978 12289 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 13:06:26.192111 12289 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 13:06:26.192358 12274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 13:06:26.192576 12274 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [term 1 LEADER]: Becoming Leader. State: Replica: 9b7b42e8a5e44ba4b19725eaa5261a31, State: Running, Role: LEADER
I20260806 13:06:26.192708 12274 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } }
I20260806 13:06:26.194585 12020 master_runner.cc:263] No leader master found from master 9b7b42e8a5e44ba4b19725eaa5261a31
I20260806 13:06:26.194664 12020 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 13:06:26.195713 12291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b7b42e8a5e44ba4b19725eaa5261a31. Latest consensus state: current_term: 1 leader_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.195856 12291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:26.196094 12293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 13:06:26.196342 12293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 13:06:26.198923 12213 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [term 1 FOLLOWER]: Refusing update from remote peer 9b7b42e8a5e44ba4b19725eaa5261a31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 13:06:26.199609 12274 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:06:26.201733 12247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b7b42e8a5e44ba4b19725eaa5261a31. Latest consensus state: current_term: 1 leader_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.201881 12247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:26.202664 12138 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [term 1 FOLLOWER]: Refusing update from remote peer 9b7b42e8a5e44ba4b19725eaa5261a31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260806 13:06:26.203191 12041 tablet.cc:2369] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 13:06:26.203083 12274 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 13:06:26.205245 12260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b7b42e8a5e44ba4b19725eaa5261a31. Latest consensus state: current_term: 1 leader_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.205380 12260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:26.208020 12244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.198171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47088 (local address 127.20.245.188:33957)
0806 13:06:26.198242 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.198244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.198654 (+ 410us) server_negotiation.cc:407] Connection header received
0806 13:06:26.198770 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.198771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.198786 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.198821 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.199821 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.200649 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.201887 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.202207 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.202254 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.204354 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.204357 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.204357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.204367 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.206522 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.206991 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.206993 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.206993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.207064 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.207322 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.207323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.207323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.207481 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.207569 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.207798 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.207900 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 13:06:26.207993 12291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.208127 12291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:26.209136 12260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.209263 12260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:26.209748 12294 mvcc.cc:205] Tried to move back new op lower bound from 7315544417066254336 to 7315544417054359552. Current Snapshot: MvccSnapshot[applied={T|T < 7315544417066254336}]
I20260806 13:06:26.209965 12300 mvcc.cc:205] Tried to move back new op lower bound from 7315544417066254336 to 7315544417054359552. Current Snapshot: MvccSnapshot[applied={T|T < 7315544417066254336}]
I20260806 13:06:26.211025 12274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.211161 12274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31 [sys.catalog]: This master's current role is: LEADER
I20260806 13:06:26.211921 12247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b7b42e8a5e44ba4b19725eaa5261a31" member_type: VOTER last_known_addr { host: "127.20.245.190" port: 33537 } } peers { permanent_uuid: "6e21123e722444dc8fb3438372d3067f" member_type: VOTER last_known_addr { host: "127.20.245.189" port: 33487 } } peers { permanent_uuid: "7025cc09118448b4af20727b1a4420f5" member_type: VOTER last_known_addr { host: "127.20.245.188" port: 33957 } } }
I20260806 13:06:26.212051 12247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 13:06:26.212539 12298 mvcc.cc:205] Tried to move back new op lower bound from 7315544417066254336 to 7315544417054359552. Current Snapshot: MvccSnapshot[applied={T|T < 7315544417066254336}]
I20260806 13:06:26.214550 12293 catalog_manager.cc:1347] Generated new cluster ID: fadc5dd0a4cf482c9c9c9795bffae404
I20260806 13:06:26.214624 12293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 13:06:26.218842 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.197642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58292 (local address 127.20.245.189:33487)
0806 13:06:26.197703 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.197706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.209026 (+ 11320us) server_negotiation.cc:407] Connection header received
0806 13:06:26.209128 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.209129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.209143 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.209175 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.209924 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.210717 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.211820 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.212115 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.212160 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.213986 (+ 1826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.213989 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.213989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.213998 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.216978 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.217501 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.217503 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.217504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.217591 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.217824 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.217825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.217826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.217994 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.218275 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.218568 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.218718 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 13:06:26.231455 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:26.197896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52822 (local address 127.20.245.190:33537)
0806 13:06:26.197943 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.197946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.205888 (+ 7942us) server_negotiation.cc:407] Connection header received
0806 13:06:26.206015 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.206017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.206032 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.206067 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.223386 (+ 17319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.224302 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.225539 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:26.225863 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:26.225912 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:26.228099 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 13:06:26.228101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 13:06:26.228102 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 13:06:26.228114 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 13:06:26.229919 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.230437 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.230438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.230439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.230502 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 13:06:26.230682 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 13:06:26.230683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 13:06:26.230683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 13:06:26.230827 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 13:06:26.230952 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:26.231219 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 13:06:26.231328 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":24}
I20260806 13:06:26.238238 12293 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 13:06:26.239166 12293 catalog_manager.cc:1504] Loading token signing keys...
I20260806 13:06:26.256769 12293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b7b42e8a5e44ba4b19725eaa5261a31: Generated new TSK 0
I20260806 13:06:26.257153 12293 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 13:06:26.297986 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.295981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52830 (local address 127.20.245.190:33537)
0806 13:06:26.296031 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.296033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.297005 (+ 972us) server_negotiation.cc:407] Connection header received
0806 13:06:26.297139 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.297141 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.297157 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.297205 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.297871 (+ 666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52830: BlockingRecv error: recv got EOF from 127.0.0.1:52830 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260806 13:06:26.298986 12244 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.296247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47094 (local address 127.20.245.188:33957)
0806 13:06:26.296300 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.296302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.298392 (+ 2090us) server_negotiation.cc:407] Connection header received
0806 13:06:26.298498 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.298500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.298515 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.298544 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.298908 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47094: BlockingRecv error: recv got EOF from 127.0.0.1:47094 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260806 13:06:26.299917 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.295671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58304 (local address 127.20.245.189:33487)
0806 13:06:26.295739 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.295741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.299313 (+ 3572us) server_negotiation.cc:407] Connection header received
0806 13:06:26.299424 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.299426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.299439 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.299472 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.299838 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58304: BlockingRecv error: recv got EOF from 127.0.0.1:58304 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260806 13:06:26.302989 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.301991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58306 (local address 127.20.245.189:33487)
0806 13:06:26.302040 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.302042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.302349 (+ 307us) server_negotiation.cc:407] Connection header received
0806 13:06:26.302473 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.302474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.302499 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.302531 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.302916 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58306: BlockingRecv error: recv got EOF from 127.0.0.1:58306 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260806 13:06:26.306715 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.305644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58316 (local address 127.20.245.189:33487)
0806 13:06:26.305696 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.305698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.306030 (+ 332us) server_negotiation.cc:407] Connection header received
0806 13:06:26.306146 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.306148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.306172 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.306205 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.306630 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58316: BlockingRecv error: recv got EOF from 127.0.0.1:58316 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260806 13:06:26.311573 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.310414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58326 (local address 127.20.245.189:33487)
0806 13:06:26.310472 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.310475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.310787 (+ 312us) server_negotiation.cc:407] Connection header received
0806 13:06:26.310910 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.310911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.310926 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.310958 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.311491 (+ 533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58326: BlockingRecv error: recv got EOF from 127.0.0.1:58326 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260806 13:06:26.318473 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.317347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58328 (local address 127.20.245.189:33487)
0806 13:06:26.317403 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.317406 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.317735 (+ 329us) server_negotiation.cc:407] Connection header received
0806 13:06:26.317861 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.317862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.317877 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.317910 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.318394 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58328: BlockingRecv error: recv got EOF from 127.0.0.1:58328 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260806 13:06:26.329527 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.328320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58340 (local address 127.20.245.189:33487)
0806 13:06:26.328385 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.328388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.328747 (+ 359us) server_negotiation.cc:407] Connection header received
0806 13:06:26.328870 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.328871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.328886 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.328920 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.329445 (+ 525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58340: BlockingRecv error: recv got EOF from 127.0.0.1:58340 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260806 13:06:26.348788 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.347580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58350 (local address 127.20.245.189:33487)
0806 13:06:26.347641 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.347644 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.347995 (+ 351us) server_negotiation.cc:407] Connection header received
0806 13:06:26.348120 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.348122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.348137 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.348189 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.348705 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58350: BlockingRecv error: recv got EOF from 127.0.0.1:58350 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260806 13:06:26.383430 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.382476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58354 (local address 127.20.245.189:33487)
0806 13:06:26.382535 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.382538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.382680 (+ 142us) server_negotiation.cc:407] Connection header received
0806 13:06:26.382784 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.382785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.382800 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.382859 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.383348 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58354: BlockingRecv error: recv got EOF from 127.0.0.1:58354 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260806 13:06:26.450321 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.449203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58360 (local address 127.20.245.189:33487)
0806 13:06:26.449335 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.449337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.449443 (+ 106us) server_negotiation.cc:407] Connection header received
0806 13:06:26.449584 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.449585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.449603 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.449701 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.450223 (+ 522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58360: BlockingRecv error: recv got EOF from 127.0.0.1:58360 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260806 13:06:26.581235 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.580038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58362 (local address 127.20.245.189:33487)
0806 13:06:26.580112 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.580114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.580312 (+ 198us) server_negotiation.cc:407] Connection header received
0806 13:06:26.580372 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.580374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.580389 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.580527 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.581089 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58362: BlockingRecv error: recv got EOF from 127.0.0.1:58362 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260806 13:06:26.839721 12168 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 13:06:26.838808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58376 (local address 127.20.245.189:33487)
0806 13:06:26.838898 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:26.838902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:26.838916 (+ 14us) server_negotiation.cc:407] Connection header received
0806 13:06:26.839003 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:26.839005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:26.839020 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:26.839102 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 13:06:26.839603 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58376: BlockingRecv error: recv got EOF from 127.0.0.1:58376 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 13:06:27.158190 12258 catalog_manager.cc:1259] Loaded cluster ID: fadc5dd0a4cf482c9c9c9795bffae404
I20260806 13:06:27.158303 12258 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5: loading cluster ID for follower catalog manager: success
I20260806 13:06:27.159389 12258 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5: acquiring CA information for follower catalog manager: success
I20260806 13:06:27.159754 12258 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7025cc09118448b4af20727b1a4420f5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 13:06:27.164115 12271 catalog_manager.cc:1259] Loaded cluster ID: fadc5dd0a4cf482c9c9c9795bffae404
I20260806 13:06:27.164217 12271 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f: loading cluster ID for follower catalog manager: success
I20260806 13:06:27.165148 12271 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f: acquiring CA information for follower catalog manager: success
I20260806 13:06:27.165494 12271 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6e21123e722444dc8fb3438372d3067f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 13:06:27.356487 12371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:27.353327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58392 (local address 127.20.245.189:33487)
0806 13:06:27.353467 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:27.353469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:27.353480 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:06:27.353552 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:27.353553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:27.353631 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:27.353748 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:27.353915 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.354525 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.355446 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.355776 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.355866 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:27.356059 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:27.356218 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:27.356309 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:27.356333 (+ 24us) server_negotiation.cc:299] Negotiation successful
0806 13:06:27.356359 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":78,"threads_started":1}
I20260806 13:06:27.361404 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:27.358591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47098 (local address 127.20.245.188:33957)
0806 13:06:27.358734 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:27.358736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:27.358746 (+ 10us) server_negotiation.cc:407] Connection header received
0806 13:06:27.358812 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:27.358813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:27.358863 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:27.358978 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:27.359060 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.359682 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.360498 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.360762 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.360847 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:27.360982 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:27.361172 (+ 190us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:27.361247 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:27.361284 (+ 37us) server_negotiation.cc:299] Negotiation successful
0806 13:06:27.361311 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260806 13:06:27.366628 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:27.363793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47110 (local address 127.20.245.188:33957)
0806 13:06:27.363910 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:27.363912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:27.363975 (+ 63us) server_negotiation.cc:407] Connection header received
0806 13:06:27.364028 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:27.364029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:27.364043 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:27.364116 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:27.364289 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.364807 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.365666 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.365913 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.365996 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:27.366193 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:27.366232 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:27.366289 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:27.366495 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 13:06:27.366533 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 13:06:27.366832 12371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:27.363510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58406 (local address 127.20.245.189:33487)
0806 13:06:27.363668 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:27.363670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:27.363681 (+ 11us) server_negotiation.cc:407] Connection header received
0806 13:06:27.363754 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:27.363756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:27.363775 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:27.363842 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:27.364067 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.364847 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.365938 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.366259 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.366350 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:27.366527 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:27.366564 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:27.366594 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:27.366705 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 13:06:27.366738 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260806 13:06:27.367096 12384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 13:06:27.363525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52842 (local address 127.20.245.190:33537)
0806 13:06:27.363684 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 13:06:27.363687 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 13:06:27.363862 (+ 175us) server_negotiation.cc:407] Connection header received
0806 13:06:27.363936 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 13:06:27.363937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 13:06:27.364018 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 13:06:27.364109 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 13:06:27.364235 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.365010 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.366000 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 13:06:27.366294 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 13:06:27.366354 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 13:06:27.366599 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 13:06:27.366744 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 13:06:27.366807 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 13:06:27.366966 (+ 159us) server_negotiation.cc:299] Negotiation successful
0806 13:06:27.366993 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260806 13:06:27.369097 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 12020
I20260806 13:06:27.377316 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 12095
I20260806 13:06:27.384406 21462 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJGA6C/build/release/bin/kudu with pid 12171
2026-08-06T13:06:27Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3091 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6278 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (312302 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST